Nov 29 07:16:28 user nova-compute[75373]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75373) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75373) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75373) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 07:16:28 user nova-compute[75373]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:16:28 user nova-compute[75373]: INFO nova.virt.driver [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 07:16:28 user nova-compute[75373]: INFO nova.compute.provider_config [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Acquiring lock "singleton_lock" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Acquired lock "singleton_lock" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Releasing lock "singleton_lock" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Full set of CONF: {{(pid=75373) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ******************************************************************************** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Configuration options gathered from: {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ================================================================================ {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] allow_resize_to_same_host      = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] arq_binding_timeout            = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] backdoor_port                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] backdoor_socket                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] block_device_allocate_retries  = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] block_device_allocate_retries_interval = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cert                           = self.pem {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:28 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute_monitors               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] config_dir                     = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] config_drive_format            = iso9660 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] config_source                  = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] console_host                   = user {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] control_exchange               = nova {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cpu_allocation_ratio           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] daemon                         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] debug                          = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_access_ip_network_name = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_availability_zone      = nova {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_ephemeral_format       = ext4 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_green_pool_size        = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] default_schedule_zone          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] disk_allocation_ratio          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] enable_new_services            = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] enabled_ssl_apis               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] flat_injected                  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] force_config_drive             = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] force_raw_images               = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] graceful_shutdown_timeout      = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] heal_instance_info_cache_interval = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] host                           = user {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_build_timeout         = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_delete_interval       = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_name_template         = instance-%08x {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_usage_audit           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_usage_audit_period    = month {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] internal_service_availability_zone = internal {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] key                            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] live_migration_retry_count     = 30 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_config_append              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_dir                        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_file                       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_options                    = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_rotate_interval            = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_rotate_interval_type       = days {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] log_rotation_type              = none {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] long_rpc_timeout               = 1800 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_concurrent_builds          = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_concurrent_live_migrations = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_concurrent_snapshots       = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_local_block_devices        = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_logfile_count              = 30 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] max_logfile_size_mb            = 200 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] maximum_instance_delete_attempts = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metadata_listen                = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metadata_listen_port           = 8775 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metadata_workers               = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] migrate_max_retries            = -1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] mkisofs_cmd                    = genisoimage {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] my_ip                          = 10.0.0.210 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] network_allocate_retries       = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] osapi_compute_listen_port      = 8774 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] osapi_compute_unique_server_name_scope =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] osapi_compute_workers          = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] password_length                = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] periodic_enable                = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] periodic_fuzzy_delay           = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] pointer_model                  = ps2mouse {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] preallocate_images             = none {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] publish_errors                 = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] pybasedir                      = /opt/stack/nova {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ram_allocation_ratio           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rate_limit_burst               = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rate_limit_except_level        = CRITICAL {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rate_limit_interval            = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reboot_timeout                 = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reclaim_instance_interval      = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] record                         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reimage_timeout_per_gb         = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] report_interval                = 120 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rescue_timeout                 = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reserved_host_cpus             = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reserved_host_disk_mb          = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reserved_host_memory_mb        = 512 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] reserved_huge_pages            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] resize_confirm_window          = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] resize_fs_using_block_device   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] resume_guests_state_on_host_boot = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rpc_response_timeout           = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] run_external_periodic_tasks    = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] running_deleted_instance_action = reap {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] running_deleted_instance_timeout = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler_instance_sync_interval = 120 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_down_time              = 720 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] servicegroup_driver            = db {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] shelved_offload_time           = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] shelved_poll_interval          = 3600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] shutdown_timeout               = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] source_is_ipv6                 = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ssl_only                       = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] state_path                     = /opt/stack/data/nova {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] sync_power_state_interval      = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] sync_power_state_pool_size     = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] syslog_log_facility            = LOG_USER {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] tempdir                        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] timeout_nbd                    = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] transport_url                  = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] update_resources_interval      = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_cow_images                 = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_eventlog                   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_journal                    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_json                       = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_rootwrap_daemon            = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_stderr                     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] use_syslog                     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vcpu_pin_set                   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plugging_is_fatal          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plugging_timeout           = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] virt_mkfs                      = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] volume_usage_poll_interval     = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] watch_log_file                 = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] web                            = /usr/share/spice-html5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_concurrency.disable_process_locking = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.auth_strategy              = keystone {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.compute_link_prefix        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.dhcp_domain                = novalocal {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.enable_instance_password   = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.glance_link_prefix         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.instance_list_per_project_cells = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.list_records_by_skipping_down_cells = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.local_metadata_per_cell    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.max_limit                  = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.metadata_cache_expiration  = 15 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.neutron_default_tenant_id  = default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.use_forwarded_for          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.use_neutron_default_nets   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_dynamic_targets = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_jsonfile_path   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.backend_argument         = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.config_prefix            = cache.oslo {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.dead_timeout             = 60.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.debug_cache_backend      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.enable_retry_client      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.enable_socket_keepalive  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.enabled                  = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.expiration_time          = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.hashclient_retry_attempts = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_dead_retry      = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_password        =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_sasl_enabled    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.memcache_username        =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.proxies                  = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.retry_attempts           = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.retry_delay              = 0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.socket_keepalive_count   = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.socket_keepalive_idle    = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.socket_keepalive_interval = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.tls_allowed_ciphers      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.tls_cafile               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.tls_certfile             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.tls_enabled              = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cache.tls_keyfile              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.auth_section            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.auth_type               = password {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.cafile                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.certfile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.collect_timing          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.cross_az_attach         = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.debug                   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.endpoint_template       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.http_retries            = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.insecure                = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.keyfile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.os_region_name          = RegionOne {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.split_loggers           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cinder.timeout                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.cpu_dedicated_set      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.cpu_shared_set         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.image_type_exclude_list = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.resource_provider_association_refresh = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.shutdown_retry_interval = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] conductor.workers              = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] console.allowed_origins        = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] console.ssl_ciphers            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] console.ssl_minimum_version    = default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] consoleauth.token_ttl          = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.cafile                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.certfile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.collect_timing          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.connect_retries         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.connect_retry_delay     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.endpoint_override       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.insecure                = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.keyfile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.max_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.min_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.region_name             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.service_name            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.service_type            = accelerator {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.split_loggers           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.status_code_retries     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.timeout                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] cyborg.version                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.backend               = sqlalchemy {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.connection            = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.connection_debug      = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.connection_parameters =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.connection_recycle_time = 3600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.connection_trace      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.db_inc_retry_interval = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.db_max_retries        = 20 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.db_max_retry_interval = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.db_retry_interval     = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.max_overflow          = 50 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.max_pool_size         = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.max_retries           = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.mysql_wsrep_sync_wait = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.pool_timeout          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.retry_interval        = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.slave_connection      = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] database.sqlite_synchronous    = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.backend           = sqlalchemy {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.connection        = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.connection_debug  = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.connection_parameters =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.connection_recycle_time = 3600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.connection_trace  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.db_inc_retry_interval = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.db_max_retries    = 20 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.db_max_retry_interval = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.db_retry_interval = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.max_overflow      = 50 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.max_pool_size     = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.max_retries       = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.pool_timeout      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.retry_interval    = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.slave_connection  = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] api_database.sqlite_synchronous = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] devices.enabled_mdev_types     = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ephemeral_storage_encryption.enabled = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.api_servers             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.cafile                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.certfile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.collect_timing          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.connect_retries         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.connect_retry_delay     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.debug                   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.default_trusted_certificate_ids = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.enable_certificate_validation = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.enable_rbd_download     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.endpoint_override       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.insecure                = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.keyfile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.max_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.min_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.num_retries             = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.rbd_ceph_conf           =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.rbd_connect_timeout     = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.rbd_pool                =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.rbd_user                =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.region_name             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.service_name            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.service_type            = image {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.split_loggers           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.status_code_retries     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.timeout                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.verify_glance_signatures = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] glance.version                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] guestfs.debug                  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.config_drive_cdrom      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.config_drive_inject_password = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.enable_remotefx         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.instances_path_share    =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.limit_cpu_features      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.use_multipath_io        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.vswitch_name            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] mks.enabled                    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.manager_interval   = 2400 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.precache_concurrency = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.remove_unused_base_images = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] image_cache.subdirectory_name  = _base {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.api_max_retries         = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.api_retry_interval      = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.auth_section            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.auth_type               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.cafile                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.certfile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.collect_timing          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.conductor_group         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.connect_retries         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.connect_retry_delay     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.endpoint_override       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.insecure                = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.keyfile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.max_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.min_version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.peer_list               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.region_name             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.serial_console_state_timeout = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.service_name            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.service_type            = baremetal {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.split_loggers           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.status_code_retries     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.timeout                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ironic.version                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] key_manager.fixed_key          = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.barbican_api_version  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.barbican_endpoint     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.barbican_endpoint_type = public {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.barbican_region_name  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.cafile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.certfile              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.collect_timing        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.insecure              = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.keyfile               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.number_of_retries     = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.retry_delay           = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.send_service_user_token = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.split_loggers         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.timeout               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.verify_ssl            = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican.verify_ssl_path       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.auth_section = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.auth_type = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.cafile   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.certfile = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.collect_timing = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.insecure = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.keyfile  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.split_loggers = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] barbican_service_user.timeout  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.approle_role_id          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.approle_secret_id        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.cafile                   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.certfile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.collect_timing           = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.insecure                 = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.keyfile                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.kv_mountpoint            = secret {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.kv_path                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.kv_version               = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.namespace                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.root_token_id            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.split_loggers            = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.ssl_ca_crt_file          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.timeout                  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.use_ssl                  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.auth_section          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.auth_type             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.cafile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.certfile              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.collect_timing        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.connect_retries       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.connect_retry_delay   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.endpoint_override     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.insecure              = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.keyfile               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.max_version           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.min_version           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.region_name           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.service_name          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.service_type          = identity {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.split_loggers         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.status_code_retries   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.timeout               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] keystone.version               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.connection_uri         =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_mode               = custom {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: WARNING oslo_config.cfg [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_power_governor_high = performance {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_power_management   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.device_detach_attempts = 8 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.device_detach_timeout  = 20 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.disk_cachemodes        = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.disk_prefix            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.enabled_perf_events    = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.file_backed_memory     = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.gid_maps               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.hw_disk_discard        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.hw_machine_type        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_rbd_pool        = rbd {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_type            = default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.images_volume_group    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.inject_key             = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.inject_partition       = -2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.inject_password        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.iscsi_iface            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.iser_use_multipath     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_downtime = 500 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_inbound_addr = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_scheme  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_timeout_action = abort {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_tunnelled = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: WARNING oslo_config.cfg [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 07:16:29 user nova-compute[75373]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 07:16:29 user nova-compute[75373]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 07:16:29 user nova-compute[75373]: and ``live_migration_inbound_addr`` respectively.
Nov 29 07:16:29 user nova-compute[75373]: ).  Its value may be silently ignored in the future.
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.live_migration_with_native_tls = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.max_queues             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.nfs_mount_options      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_pcie_ports         = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.pmem_namespaces        = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.quobyte_client_cfg     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rbd_secret_uuid        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rbd_user               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rescue_image_id        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rescue_kernel_id       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.rx_queue_size          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.smbfs_mount_options    =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.snapshot_compression   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.snapshot_image_format  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.sparse_logical_volumes = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.swtpm_enabled          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.swtpm_group            = tss {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.swtpm_user             = tss {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.sysinfo_serial         = unique {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.tb_cache_size          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.tx_queue_size          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.uid_maps               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.use_virtio_for_bridges = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.virt_type              = kvm {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.volume_clear           = zero {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.volume_clear_size      = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.volume_use_multipath   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_cache_path   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.auth_section           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.auth_type              = password {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.cafile                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.certfile               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.collect_timing         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.connect_retries        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.connect_retry_delay    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.default_floating_pool  = public {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.endpoint_override      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.extension_sync_interval = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.http_retries           = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.insecure               = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.keyfile                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.max_version            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.min_version            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.ovs_bridge             = br-int {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.physnets               = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.region_name            = RegionOne {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.service_metadata_proxy = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.service_name           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.service_type           = network {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.split_loggers          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.status_code_retries    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.timeout                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] neutron.version                = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] notifications.bdms_in_notifications = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] notifications.default_level    = INFO {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] notifications.notification_format = unversioned {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] notifications.notify_on_state_change = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] pci.alias                      = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] pci.device_spec                = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] pci.report_in_placement        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.auth_section         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.auth_type            = password {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.cafile               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.certfile             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.collect_timing       = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.connect_retries      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.connect_retry_delay  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.default_domain_id    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.default_domain_name  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.domain_id            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.domain_name          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.endpoint_override    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.insecure             = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.keyfile              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.max_version          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.min_version          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.password             = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.project_domain_id    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.project_domain_name  = Default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.project_id           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.project_name         = service {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.region_name          = RegionOne {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.service_name         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.service_type         = placement {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.split_loggers        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.status_code_retries  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.system_scope         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.timeout              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.trust_id             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.user_domain_id       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.user_domain_name     = Default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.user_id              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.username             = placement {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] placement.version              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.cores                    = 20 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.count_usage_from_placement = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.injected_file_content_bytes = 10240 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.injected_file_path_length = 255 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.injected_files           = 5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.instances                = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.key_pairs                = 100 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.metadata_items           = 128 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.ram                      = 51200 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.recheck_quota            = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.server_group_members     = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] quota.server_groups            = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rdp.enabled                    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.image_metadata_prefilter = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.max_attempts         = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.max_placement_results = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] scheduler.workers              = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.host_subset_size = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.isolated_hosts = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.isolated_images = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.pci_in_placement = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.track_instance_changes = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metrics.required               = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metrics.weight_multiplier      = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] metrics.weight_setting         = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.enabled         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.port_range      = 10000:20000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] serial_console.serialproxy_port = 6083 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.auth_section      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.auth_type         = password {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.cafile            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.certfile          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.collect_timing    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.insecure          = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.keyfile           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.send_service_user_token = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.split_loggers     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] service_user.timeout           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.agent_enabled            = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.enabled                  = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.html5proxy_port          = 6082 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.image_compression        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.jpeg_compression         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.playback_compression     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.server_listen            = 127.0.0.1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.streaming_mode           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] spice.zlib_compression         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] upgrade_levels.baseapi         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] upgrade_levels.compute         = auto {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] upgrade_levels.conductor       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] upgrade_levels.scheduler       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.cafile = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.certfile = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.insecure = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vendordata_dynamic_auth.timeout = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.api_retry_count         = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.ca_file                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.cache_prefix            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.cluster_name            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.connection_pool_size    = 10 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.console_delay_seconds   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.datastore_regex         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.host_ip                 = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.host_password           = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.host_port               = 443 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.host_username           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.insecure                = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.integration_bridge      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.maximum_objects         = 100 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.pbm_default_policy      = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.pbm_enabled             = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.pbm_wsdl_location       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.serial_port_proxy_uri   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.serial_port_service_uri = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.task_poll_interval      = 0.5 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.use_linked_clone        = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.vnc_keymap              = en-us {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.vnc_port                = 5900 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vmware.vnc_port_total          = 10000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.auth_schemes               = ['none'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.enabled                    = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.novncproxy_port            = 6080 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.vencrypt_ca_certs          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.vencrypt_client_cert       = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vnc.vencrypt_client_key        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.disable_rootwrap   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.enable_numa_live_migration = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.libvirt_disable_apic = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.client_socket_timeout     = 900 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.default_pool_size         = 1000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.keep_alive                = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.max_header_line           = 16384 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.ssl_ca_file               = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.ssl_cert_file             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.ssl_key_file              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.tcp_keepidle              = 600 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] zvm.ca_file                    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] zvm.cloud_connector_url        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] zvm.reachable_timeout          = 300 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.enforce_new_defaults = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.enforce_scope      = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.policy_default_rule = default {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.connection_string     = messaging:// {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.enabled               = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.es_doc_type           = notification {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.es_scroll_size        = 10000 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.es_scroll_time        = 2m {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.filter_error_trace    = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.hmac_keys             = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.sentinel_service_name = mymaster {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.socket_timeout        = 0.1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.trace_requests        = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler.trace_sqlalchemy      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler_jaeger.process_tags   = {} {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler_jaeger.service_name_prefix = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] profiler_otlp.service_name_prefix = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] remote_debug.host              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] remote_debug.port              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_notifications.retry = -1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.auth_section        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.auth_type           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.cafile              = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.certfile            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.collect_timing      = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.connect_retries     = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.connect_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.endpoint_id         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.endpoint_override   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.insecure            = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.keyfile             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.max_version         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.min_version         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.region_name         = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.service_name        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.service_type        = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.split_loggers       = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.status_code_retries = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.status_code_retry_delay = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.timeout             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.valid_interfaces    = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_limit.version             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_reports.file_event_handler = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] oslo_reports.log_dir           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.group  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] vif_plug_ovs_privileged.user   = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.isolate_vif         = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] os_brick.lock_path             = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.capabilities   = [21] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.group          = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.helper_command = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] privsep_osbrick.user           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.group           = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.helper_command  = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] nova_sys_admin.user            = None {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG oslo_service.service [None req-96634cde-827a-4a87-b0c9-168efe8b247a None None] ******************************************************************************** {{(pid=75373) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 07:16:29 user nova-compute[75373]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Connecting to libvirt: qemu:///system {{(pid=75373) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3b08a56410> {{(pid=75373) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 07:16:29 user nova-compute[75373]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 07:16:29 user nova-compute[75373]: WARNING nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3b08a56410> {{(pid=75373) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Starting native event thread {{(pid=75373) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Starting green dispatch thread {{(pid=75373) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Starting connection event dispatch thread {{(pid=75373) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 07:16:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Connection event '1' reason 'None'
Nov 29 07:16:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 07:16:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.mount [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Initialising _HostMountState generation 0 {{(pid=75373) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host capabilities <capabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <host>
Nov 29 07:16:37 user nova-compute[75373]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 07:16:37 user nova-compute[75373]:     <cpu>
Nov 29 07:16:37 user nova-compute[75373]:       <arch>x86_64</arch>
Nov 29 07:16:37 user nova-compute[75373]:       <model>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <microcode version='1070'/>
Nov 29 07:16:37 user nova-compute[75373]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='osxsave'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='invtsc'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='rsba'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 07:16:37 user nova-compute[75373]:       <pages unit='KiB' size='4'/>
Nov 29 07:16:37 user nova-compute[75373]:       <pages unit='KiB' size='2048'/>
Nov 29 07:16:37 user nova-compute[75373]:     </cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <power_management>
Nov 29 07:16:37 user nova-compute[75373]:       <suspend_mem/>
Nov 29 07:16:37 user nova-compute[75373]:       <suspend_disk/>
Nov 29 07:16:37 user nova-compute[75373]:       <suspend_hybrid/>
Nov 29 07:16:37 user nova-compute[75373]:     </power_management>
Nov 29 07:16:37 user nova-compute[75373]:     <iommu support='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <migration_features>
Nov 29 07:16:37 user nova-compute[75373]:       <live/>
Nov 29 07:16:37 user nova-compute[75373]:       <uri_transports>
Nov 29 07:16:37 user nova-compute[75373]:         <uri_transport>tcp</uri_transport>
Nov 29 07:16:37 user nova-compute[75373]:         <uri_transport>rdma</uri_transport>
Nov 29 07:16:37 user nova-compute[75373]:       </uri_transports>
Nov 29 07:16:37 user nova-compute[75373]:     </migration_features>
Nov 29 07:16:37 user nova-compute[75373]:     <topology>
Nov 29 07:16:37 user nova-compute[75373]:       <cells num='2'>
Nov 29 07:16:37 user nova-compute[75373]:         <cell id='0'>
Nov 29 07:16:37 user nova-compute[75373]:           <memory unit='KiB'>8189224</memory>
Nov 29 07:16:37 user nova-compute[75373]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 29 07:16:37 user nova-compute[75373]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 07:16:37 user nova-compute[75373]:           <distances>
Nov 29 07:16:37 user nova-compute[75373]:             <sibling id='0' value='10'/>
Nov 29 07:16:37 user nova-compute[75373]:             <sibling id='1' value='20'/>
Nov 29 07:16:37 user nova-compute[75373]:           </distances>
Nov 29 07:16:37 user nova-compute[75373]:           <cpus num='6'>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 07:16:37 user nova-compute[75373]:           </cpus>
Nov 29 07:16:37 user nova-compute[75373]:         </cell>
Nov 29 07:16:37 user nova-compute[75373]:         <cell id='1'>
Nov 29 07:16:37 user nova-compute[75373]:           <memory unit='KiB'>8206460</memory>
Nov 29 07:16:37 user nova-compute[75373]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 29 07:16:37 user nova-compute[75373]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 07:16:37 user nova-compute[75373]:           <distances>
Nov 29 07:16:37 user nova-compute[75373]:             <sibling id='0' value='20'/>
Nov 29 07:16:37 user nova-compute[75373]:             <sibling id='1' value='10'/>
Nov 29 07:16:37 user nova-compute[75373]:           </distances>
Nov 29 07:16:37 user nova-compute[75373]:           <cpus num='6'>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 07:16:37 user nova-compute[75373]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 07:16:37 user nova-compute[75373]:           </cpus>
Nov 29 07:16:37 user nova-compute[75373]:         </cell>
Nov 29 07:16:37 user nova-compute[75373]:       </cells>
Nov 29 07:16:37 user nova-compute[75373]:     </topology>
Nov 29 07:16:37 user nova-compute[75373]:     <cache>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 07:16:37 user nova-compute[75373]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 07:16:37 user nova-compute[75373]:     </cache>
Nov 29 07:16:37 user nova-compute[75373]:     <secmodel>
Nov 29 07:16:37 user nova-compute[75373]:       <model>apparmor</model>
Nov 29 07:16:37 user nova-compute[75373]:       <doi>0</doi>
Nov 29 07:16:37 user nova-compute[75373]:     </secmodel>
Nov 29 07:16:37 user nova-compute[75373]:     <secmodel>
Nov 29 07:16:37 user nova-compute[75373]:       <model>dac</model>
Nov 29 07:16:37 user nova-compute[75373]:       <doi>0</doi>
Nov 29 07:16:37 user nova-compute[75373]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 07:16:37 user nova-compute[75373]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 07:16:37 user nova-compute[75373]:     </secmodel>
Nov 29 07:16:37 user nova-compute[75373]:   </host>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='alpha'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>clipper</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='armv6l'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>spitz</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>nuri</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>kzm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>z2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>tosa</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n810</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>terrier</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>midway</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>microbit</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>verdex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>highbank</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>akita</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>connex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>collie</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='armv7l'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>spitz</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>nuri</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>kzm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>z2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>tosa</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n810</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>terrier</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>midway</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>microbit</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>verdex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>highbank</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>akita</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>connex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>collie</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='aarch64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>spitz</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>nuri</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>kzm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>z2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>tosa</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n810</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>n800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>terrier</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>midway</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>microbit</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>verdex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>highbank</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>akita</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>connex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>collie</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <acpi default='on' toggle='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='cris'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='i686'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>isapc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>microvm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='kvm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <pae/>
Nov 29 07:16:37 user nova-compute[75373]:       <nonpae/>
Nov 29 07:16:37 user nova-compute[75373]:       <acpi default='on' toggle='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:       <apic default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='m68k'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>an5206</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>q800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='microblaze'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='microblazeel'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='mips'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>malta</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='mipsel'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>malta</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='mips64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>malta</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>pica61</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>magnum</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='mips64el'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>malta</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>pica61</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>magnum</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='16'>boston</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='ppc'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mac99</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>40p</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>taihu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='ppc64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>taihu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>40p</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mac99</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='ppc64le'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>taihu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>40p</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>mac99</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='riscv32'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='8'>spike</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='8'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='riscv64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='8'>spike</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='8'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='s390x'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='sh4'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>shix</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>r2d</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='sh4eb'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>shix</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>r2d</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='sparc'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>LX</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='sparc64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>niagara</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='x86_64'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>64</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='1'>isapc</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>microvm</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='kvm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <acpi default='on' toggle='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:       <apic default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='xtensa'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>sim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>kc705</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ml605</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx200</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx60</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]:   <guest>
Nov 29 07:16:37 user nova-compute[75373]:     <os_type>hvm</os_type>
Nov 29 07:16:37 user nova-compute[75373]:     <arch name='xtensaeb'>
Nov 29 07:16:37 user nova-compute[75373]:       <wordsize>32</wordsize>
Nov 29 07:16:37 user nova-compute[75373]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='4'>sim</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>kc705</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ml605</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>virt</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx200</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>lx60</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 07:16:37 user nova-compute[75373]:       <domain type='qemu'/>
Nov 29 07:16:37 user nova-compute[75373]:     </arch>
Nov 29 07:16:37 user nova-compute[75373]:     <features>
Nov 29 07:16:37 user nova-compute[75373]:       <cpuselection/>
Nov 29 07:16:37 user nova-compute[75373]:       <deviceboot/>
Nov 29 07:16:37 user nova-compute[75373]:       <disksnapshot default='on' toggle='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     </features>
Nov 29 07:16:37 user nova-compute[75373]:   </guest>
Nov 29 07:16:37 user nova-compute[75373]: </capabilities>
Nov 29 07:16:37 user nova-compute[75373]: 
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-i440fx-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>i686</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='255'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'/>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='lm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ide</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-i440fx-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>i686</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='255'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'/>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='lm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ide</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-q35-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>i686</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='288'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'/>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='lm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-q35-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>i686</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='288'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'/>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='lm'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-i440fx-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>x86_64</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='255'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>efi</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='invtsc'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='rsba'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ide</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-i440fx-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>x86_64</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='255'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>efi</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='invtsc'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='rsba'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ide</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-q35-6.2</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>x86_64</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='288'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>efi</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='invtsc'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='rsba'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 07:16:37 user nova-compute[75373]: <domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 07:16:37 user nova-compute[75373]:   <domain>kvm</domain>
Nov 29 07:16:37 user nova-compute[75373]:   <machine>pc-q35-jammy</machine>
Nov 29 07:16:37 user nova-compute[75373]:   <arch>x86_64</arch>
Nov 29 07:16:37 user nova-compute[75373]:   <vcpu max='288'/>
Nov 29 07:16:37 user nova-compute[75373]:   <iothreads supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:   <os supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='firmware'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>efi</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:     <loader supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>rom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pflash</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='readonly'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='secure'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>yes</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>no</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </loader>
Nov 29 07:16:37 user nova-compute[75373]:   </os>
Nov 29 07:16:37 user nova-compute[75373]:   <cpu>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-passthrough' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='hostPassthroughMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='maximum' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='maximumMigratable'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>on</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>off</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='host-model' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <vendor>Intel</vendor>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ss'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='vmx'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pcid'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='hypervisor'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arat'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='umip'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='md-clear'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='invtsc'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibpb'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='ibrs'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-stibp'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='rsba'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='erms'/>
Nov 29 07:16:37 user nova-compute[75373]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:     <mode name='custom' supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>qemu64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>qemu32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>phenom</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>pentium</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>n270</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm64</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>kvm32</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>coreduo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>core2duo</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>athlon</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Westmere</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Snowridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Skylake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>SandyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Penryn</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G5</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G4</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G3</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Opteron_G2</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Opteron_G1</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>IvyBridge</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Icelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Haswell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Rome</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-Milan</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>EPYC</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Dhyana</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cooperlake</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>Conroe</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='no'>Broadwell</model>
Nov 29 07:16:37 user nova-compute[75373]:       <model usable='yes'>486</model>
Nov 29 07:16:37 user nova-compute[75373]:     </mode>
Nov 29 07:16:37 user nova-compute[75373]:   </cpu>
Nov 29 07:16:37 user nova-compute[75373]:   <memoryBacking supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:     <enum name='sourceType'>
Nov 29 07:16:37 user nova-compute[75373]:       <value>file</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>anonymous</value>
Nov 29 07:16:37 user nova-compute[75373]:       <value>memfd</value>
Nov 29 07:16:37 user nova-compute[75373]:     </enum>
Nov 29 07:16:37 user nova-compute[75373]:   </memoryBacking>
Nov 29 07:16:37 user nova-compute[75373]:   <devices>
Nov 29 07:16:37 user nova-compute[75373]:     <disk supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='diskDevice'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>disk</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cdrom</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>floppy</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>lun</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='bus'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>fdc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sata</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </disk>
Nov 29 07:16:37 user nova-compute[75373]:     <graphics supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='type'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>sdl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vnc</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>spice</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egl-headless</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </graphics>
Nov 29 07:16:37 user nova-compute[75373]:     <video supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='modelType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>cirrus</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>vmvga</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>qxl</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>none</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>bochs</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>ramfb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </video>
Nov 29 07:16:37 user nova-compute[75373]:     <hostdev supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='mode'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>subsystem</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='startupPolicy'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>default</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>mandatory</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>requisite</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>optional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='subsysType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>usb</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>pci</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>scsi</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='capsType'/>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='pciBackend'/>
Nov 29 07:16:37 user nova-compute[75373]:     </hostdev>
Nov 29 07:16:37 user nova-compute[75373]:     <rng supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtio-non-transitional</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>random</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>egd</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>builtin</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </rng>
Nov 29 07:16:37 user nova-compute[75373]:     <filesystem supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='driverType'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>path</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>handle</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>virtiofs</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </filesystem>
Nov 29 07:16:37 user nova-compute[75373]:     <tpm supported='yes'>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='model'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-tis</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>tpm-crb</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:       <enum name='backendModel'>
Nov 29 07:16:37 user nova-compute[75373]:         <value>passthrough</value>
Nov 29 07:16:37 user nova-compute[75373]:         <value>emulator</value>
Nov 29 07:16:37 user nova-compute[75373]:       </enum>
Nov 29 07:16:37 user nova-compute[75373]:     </tpm>
Nov 29 07:16:37 user nova-compute[75373]:   </devices>
Nov 29 07:16:37 user nova-compute[75373]:   <features>
Nov 29 07:16:37 user nova-compute[75373]:     <gic supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:     <vmcoreinfo supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <genid supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backingStoreInput supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <backup supported='yes'/>
Nov 29 07:16:37 user nova-compute[75373]:     <sev supported='no'/>
Nov 29 07:16:37 user nova-compute[75373]:   </features>
Nov 29 07:16:37 user nova-compute[75373]: </domainCapabilities>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75373) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75373) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Checking secure boot support for host arch (x86_64) {{(pid=75373) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Checking secure boot support for host arch (x86_64) {{(pid=75373) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Checking secure boot support for host arch (x86_64) {{(pid=75373) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Checking secure boot support for host arch (x86_64) {{(pid=75373) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Checking secure boot support for host arch (x86_64) {{(pid=75373) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Secure Boot support detected
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] cpu compare xml: <cpu match="exact">
Nov 29 07:16:37 user nova-compute[75373]:   <model>Nehalem</model>
Nov 29 07:16:37 user nova-compute[75373]: </cpu>
Nov 29 07:16:37 user nova-compute[75373]:  {{(pid=75373) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.virt.node [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Generated node identity 7470e514-a168-44fb-900f-165629289ced
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.virt.node [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Wrote node identity 7470e514-a168-44fb-900f-165629289ced to /opt/stack/data/nova/compute_id
Nov 29 07:16:37 user nova-compute[75373]: WARNING nova.compute.manager [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Compute nodes ['7470e514-a168-44fb-900f-165629289ced'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.compute.manager [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 07:16:37 user nova-compute[75373]: WARNING nova.compute.manager [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 07:16:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:16:37 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:16:37 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Hypervisor/Node resource view: name=user free_ram=10993MB free_disk=26.262027740478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:16:37 user nova-compute[75373]: WARNING nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] No compute node record for user:7470e514-a168-44fb-900f-165629289ced: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7470e514-a168-44fb-900f-165629289ced could not be found.
Nov 29 07:16:37 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Compute node record created for user:user with uuid: 7470e514-a168-44fb-900f-165629289ced
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:16:37 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:16:38 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] [req-61f1472d-15b1-45e4-b39f-abe7acb5f6d1] Created resource provider record via placement API for resource provider with UUID 7470e514-a168-44fb-900f-165629289ced and name user.
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75373) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 07:16:38 user nova-compute[75373]: INFO nova.virt.libvirt.host [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] kernel doesn't support AMD SEV
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Libvirt baseline CPU <cpu>
Nov 29 07:16:38 user nova-compute[75373]:   <arch>x86_64</arch>
Nov 29 07:16:38 user nova-compute[75373]:   <model>Nehalem</model>
Nov 29 07:16:38 user nova-compute[75373]:   <vendor>Intel</vendor>
Nov 29 07:16:38 user nova-compute[75373]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 07:16:38 user nova-compute[75373]: </cpu>
Nov 29 07:16:38 user nova-compute[75373]:  {{(pid=75373) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Updated inventory for provider 7470e514-a168-44fb-900f-165629289ced with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Updating resource provider 7470e514-a168-44fb-900f-165629289ced generation from 0 to 1 during operation: update_inventory {{(pid=75373) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Updating resource provider 7470e514-a168-44fb-900f-165629289ced generation from 1 to 2 during operation: update_traits {{(pid=75373) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.service [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Creating RPC server for service compute {{(pid=75373) start /opt/stack/nova/nova/service.py:182}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.service [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] Join ServiceGroup membership for this service compute {{(pid=75373) start /opt/stack/nova/nova/service.py:199}}
Nov 29 07:16:38 user nova-compute[75373]: DEBUG nova.servicegroup.drivers.db [None req-b4b7f898-190f-4043-8175-ce18f9929442 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75373) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 07:17:24 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:24 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:17:28 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:17:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:17:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=10470MB free_disk=26.02459716796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:17:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:18:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:18:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=10393MB free_disk=26.089588165283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:18:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:18:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:19:29 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:19:30 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:19:31 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:19:31 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=25.841373443603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:19:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:19:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:19:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:20:29 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:31 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:20:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:20:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:20:31 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:32 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:20:33 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:33 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9706MB free_disk=25.862201690673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:20:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:20:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:20:44 user nova-compute[75373]: INFO nova.compute.claims [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Claim successful on node user
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:20:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:20:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Creating image(s)
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "/opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "/opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "/opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:44 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:20:44 user nova-compute[75373]: INFO nova.compute.claims [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Claim successful on node user
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.policy [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad1e98486b240358cbda80031ef96df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e46125e574accb1c6590e0b3c59c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.part --force-share --output=json" returned: 0 in 0.224s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.virt.images [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] f913c500-a725-42d4-bfc8-b62422a3c4fa was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.part /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.part /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.converted" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:20:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Creating image(s)
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "/opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "/opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "/opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.270s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:46 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8urapu7b/privsep.sock']
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.121s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.policy [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bc76bca5efd4f1aaf1250f9d63d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4071c6738f4509a906b090b5ffdb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user sudo[84634]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8urapu7b/privsep.sock
Nov 29 07:20:46 user sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:20:46 user nova-compute[75373]: INFO nova.compute.claims [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Claim successful on node user
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.112s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:20:46 user nova-compute[75373]: INFO nova.compute.claims [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Claim successful on node user
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:20:46 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:20:46 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Creating image(s)
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.policy [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333925d6528d4e68bd23098c2f3513e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4259f5c423c347c8b36a7594ccec40cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Successfully created port: eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.092s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:20:47 user nova-compute[75373]: INFO nova.compute.claims [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Claim successful on node user
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:20:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:20:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Creating image(s)
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "/opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "/opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "/opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.policy [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3d603a0cab4a7da1c743c26b73540d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f10657321e44f49a30fedbe20dddcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:20:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:20:47 user sudo[84634]: pam_unix(sudo:session): session closed for user root
Nov 29 07:20:47 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Spawned new privsep daemon via rootwrap
Nov 29 07:20:47 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 07:20:47 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 07:20:47 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 07:20:47 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84637
Nov 29 07:20:47 user nova-compute[75373]: WARNING oslo_privsep.priv_context [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] privsep daemon already running
Nov 29 07:20:47 user nova-compute[75373]: WARNING oslo_privsep.priv_context [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] privsep daemon already running
Nov 29 07:20:47 user nova-compute[75373]: WARNING oslo_privsep.priv_context [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] privsep daemon already running
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.policy [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333925d6528d4e68bd23098c2f3513e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4259f5c423c347c8b36a7594ccec40cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:20:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Creating image(s)
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.210s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.167s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.158s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk 1073741824" returned: 0 in 0.040s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.198s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk 1073741824" returned: 0 in 0.045s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.464s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Cannot resize image /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Ensure instance console log exists: /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk 1073741824" returned: 0 in 0.047s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.659s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Cannot resize image /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Ensure instance console log exists: /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk 1073741824" returned: 0 in 0.047s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.891s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Cannot resize image /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Ensure instance console log exists: /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk 1073741824" returned: 0 in 0.060s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Successfully created port: c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Cannot resize image /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Ensure instance console log exists: /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Successfully updated port: eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquired lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Cannot resize image /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Ensure instance console log exists: /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:20:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Successfully created port: 1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-changed-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Refreshing instance network info cache due to event network-changed-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] Acquiring lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Successfully created port: 36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:20:50 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Successfully created port: 86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating instance_info_cache with network_info: [{"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Releasing lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Instance network_info: |[{"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] Acquired lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Refreshing network info cache for port eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Start _get_guest_xml network_info=[{"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:20:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1067214700',display_name='tempest-DeleteServersTestJSON-server-1067214700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1067214700',id=1,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e46125e574accb1c6590e0b3c59c3',ramdisk_id='',reservation_id='r-m537ezt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1785512475',owner_user_name='tempest-DeleteServersTestJSON-1785512475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:45Z,user_data=None,user_id='aad1e98486b240358cbda80031ef96df',uuid=6040b882-4024-457a-8f26-8ee29cb54cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converting VIF {"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lazy-loading 'pci_devices' on Instance uuid 6040b882-4024-457a-8f26-8ee29cb54cc6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:20:51 user nova-compute[75373]:   <uuid>6040b882-4024-457a-8f26-8ee29cb54cc6</uuid>
Nov 29 07:20:51 user nova-compute[75373]:   <name>instance-00000001</name>
Nov 29 07:20:51 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:20:51 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:20:51 user nova-compute[75373]:   <metadata>
Nov 29 07:20:51 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:20:51 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:name>tempest-DeleteServersTestJSON-server-1067214700</nova:name>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:20:51</nova:creationTime>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:20:51 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:20:51 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:owner>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:user uuid="aad1e98486b240358cbda80031ef96df">tempest-DeleteServersTestJSON-1785512475-project-member</nova:user>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:project uuid="7c4e46125e574accb1c6590e0b3c59c3">tempest-DeleteServersTestJSON-1785512475</nova:project>
Nov 29 07:20:51 user nova-compute[75373]:       </nova:owner>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:20:51 user nova-compute[75373]:       <nova:ports>
Nov 29 07:20:51 user nova-compute[75373]:         <nova:port uuid="eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59">
Nov 29 07:20:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:20:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:20:51 user nova-compute[75373]:       </nova:ports>
Nov 29 07:20:51 user nova-compute[75373]:     </nova:instance>
Nov 29 07:20:51 user nova-compute[75373]:   </metadata>
Nov 29 07:20:51 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:20:51 user nova-compute[75373]:     <system>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="serial">6040b882-4024-457a-8f26-8ee29cb54cc6</entry>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="uuid">6040b882-4024-457a-8f26-8ee29cb54cc6</entry>
Nov 29 07:20:51 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:20:51 user nova-compute[75373]:     </system>
Nov 29 07:20:51 user nova-compute[75373]:   </sysinfo>
Nov 29 07:20:51 user nova-compute[75373]:   <os>
Nov 29 07:20:51 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:20:51 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:20:51 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:20:51 user nova-compute[75373]:   </os>
Nov 29 07:20:51 user nova-compute[75373]:   <features>
Nov 29 07:20:51 user nova-compute[75373]:     <acpi/>
Nov 29 07:20:51 user nova-compute[75373]:     <apic/>
Nov 29 07:20:51 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:20:51 user nova-compute[75373]:   </features>
Nov 29 07:20:51 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:20:51 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:20:51 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:20:51 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:20:51 user nova-compute[75373]:   </clock>
Nov 29 07:20:51 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:20:51 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:20:51 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:20:51 user nova-compute[75373]:   </cpu>
Nov 29 07:20:51 user nova-compute[75373]:   <devices>
Nov 29 07:20:51 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:20:51 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:20:51 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk"/>
Nov 29 07:20:51 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:20:51 user nova-compute[75373]:     </disk>
Nov 29 07:20:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:20:51 user nova-compute[75373]:       <mac address="fa:16:3e:a3:2e:6c"/>
Nov 29 07:20:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:20:51 user nova-compute[75373]:       <target dev="tapeff47ecd-7f"/>
Nov 29 07:20:51 user nova-compute[75373]:     </interface>
Nov 29 07:20:51 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:20:51 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/console.log" append="off"/>
Nov 29 07:20:51 user nova-compute[75373]:     </serial>
Nov 29 07:20:51 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:20:51 user nova-compute[75373]:     <video>
Nov 29 07:20:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:51 user nova-compute[75373]:     </video>
Nov 29 07:20:51 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:20:51 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:20:51 user nova-compute[75373]:     </rng>
Nov 29 07:20:51 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:20:51 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:20:51 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:20:51 user nova-compute[75373]:     </memballoon>
Nov 29 07:20:51 user nova-compute[75373]:   </devices>
Nov 29 07:20:51 user nova-compute[75373]: </domain>
Nov 29 07:20:51 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1067214700',display_name='tempest-DeleteServersTestJSON-server-1067214700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1067214700',id=1,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c4e46125e574accb1c6590e0b3c59c3',ramdisk_id='',reservation_id='r-m537ezt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1785512475',owner_user_name='tempest-DeleteServersTestJSON-1785512475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:45Z,user_data=None,user_id='aad1e98486b240358cbda80031ef96df',uuid=6040b882-4024-457a-8f26-8ee29cb54cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converting VIF {"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG os_vif [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Created schema index Interface.name {{(pid=75373) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Created schema index Port.name {{(pid=75373) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Created schema index Bridge.name {{(pid=75373) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [POLLOUT] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fcaccc1-cf70-5ef5-971e-3c05433f8715', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:51 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpvabumc1a/privsep.sock']
Nov 29 07:20:51 user sudo[84750]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpvabumc1a/privsep.sock
Nov 29 07:20:51 user sudo[84750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 07:20:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Successfully updated port: 1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:20:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:20:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Successfully updated port: c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-changed-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Refreshing instance network info cache due to event network-changed-1f6722af-05ac-4430-92df-0f566d4c9ef4. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] Acquiring lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquired lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:20:53 user sudo[84750]: pam_unix(sudo:session): session closed for user root
Nov 29 07:20:53 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Spawned new privsep daemon via rootwrap
Nov 29 07:20:53 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 07:20:53 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 07:20:53 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 07:20:53 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84753
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updated VIF entry in instance network info cache for port eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating instance_info_cache with network_info: [{"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16d9ce8c-4470-42d4-81a3-cad2f37772db req-69127f7a-4a9f-47a7-81a2-e44eaf213c9f service nova] Releasing lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Successfully updated port: 86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing instance network info cache due to event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance network_info: |[{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] Acquired lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Refreshing network info cache for port 1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start _get_guest_xml network_info=[{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:20:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622522295',display_name='tempest-ServerRescueNegativeTestJSON-server-622522295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622522295',id=5,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-o5yu09jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:48Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=6aff3409-81c6-4c41-9a03-8f4abfb318c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.objects.instance [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:20:53 user nova-compute[75373]:   <uuid>6aff3409-81c6-4c41-9a03-8f4abfb318c9</uuid>
Nov 29 07:20:53 user nova-compute[75373]:   <name>instance-00000005</name>
Nov 29 07:20:53 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:20:53 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:20:53 user nova-compute[75373]:   <metadata>
Nov 29 07:20:53 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:20:53 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-622522295</nova:name>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:20:53</nova:creationTime>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:20:53 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:20:53 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:owner>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:20:53 user nova-compute[75373]:       </nova:owner>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:20:53 user nova-compute[75373]:       <nova:ports>
Nov 29 07:20:53 user nova-compute[75373]:         <nova:port uuid="1f6722af-05ac-4430-92df-0f566d4c9ef4">
Nov 29 07:20:53 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:20:53 user nova-compute[75373]:         </nova:port>
Nov 29 07:20:53 user nova-compute[75373]:       </nova:ports>
Nov 29 07:20:53 user nova-compute[75373]:     </nova:instance>
Nov 29 07:20:53 user nova-compute[75373]:   </metadata>
Nov 29 07:20:53 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:20:53 user nova-compute[75373]:     <system>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="serial">6aff3409-81c6-4c41-9a03-8f4abfb318c9</entry>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="uuid">6aff3409-81c6-4c41-9a03-8f4abfb318c9</entry>
Nov 29 07:20:53 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:20:53 user nova-compute[75373]:     </system>
Nov 29 07:20:53 user nova-compute[75373]:   </sysinfo>
Nov 29 07:20:53 user nova-compute[75373]:   <os>
Nov 29 07:20:53 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:20:53 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:20:53 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:20:53 user nova-compute[75373]:   </os>
Nov 29 07:20:53 user nova-compute[75373]:   <features>
Nov 29 07:20:53 user nova-compute[75373]:     <acpi/>
Nov 29 07:20:53 user nova-compute[75373]:     <apic/>
Nov 29 07:20:53 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:20:53 user nova-compute[75373]:   </features>
Nov 29 07:20:53 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:20:53 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:20:53 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:20:53 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:20:53 user nova-compute[75373]:   </clock>
Nov 29 07:20:53 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:20:53 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:20:53 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:20:53 user nova-compute[75373]:   </cpu>
Nov 29 07:20:53 user nova-compute[75373]:   <devices>
Nov 29 07:20:53 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:20:53 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:20:53 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk"/>
Nov 29 07:20:53 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:20:53 user nova-compute[75373]:     </disk>
Nov 29 07:20:53 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:20:53 user nova-compute[75373]:       <mac address="fa:16:3e:76:bb:fa"/>
Nov 29 07:20:53 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:53 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:20:53 user nova-compute[75373]:       <target dev="tap1f6722af-05"/>
Nov 29 07:20:53 user nova-compute[75373]:     </interface>
Nov 29 07:20:53 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:20:53 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/console.log" append="off"/>
Nov 29 07:20:53 user nova-compute[75373]:     </serial>
Nov 29 07:20:53 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:20:53 user nova-compute[75373]:     <video>
Nov 29 07:20:53 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:53 user nova-compute[75373]:     </video>
Nov 29 07:20:53 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:20:53 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:20:53 user nova-compute[75373]:     </rng>
Nov 29 07:20:53 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:20:53 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:20:53 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:20:53 user nova-compute[75373]:     </memballoon>
Nov 29 07:20:53 user nova-compute[75373]:   </devices>
Nov 29 07:20:53 user nova-compute[75373]: </domain>
Nov 29 07:20:53 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622522295',display_name='tempest-ServerRescueNegativeTestJSON-server-622522295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622522295',id=5,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-o5yu09jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:48Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=6aff3409-81c6-4c41-9a03-8f4abfb318c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG os_vif [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f224773f-4832-5398-9f19-2c3ade72c604', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-changed-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Refreshing instance network info cache due to event network-changed-c620401f-da47-4341-9f82-c97ceea48d9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] Acquiring lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6722af-05, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f6722af-05, col_values=(('qos', UUID('f60a72c3-7437-455e-b925-42c60fd46873')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f6722af-05, col_values=(('external_ids', {'iface-id': '1f6722af-05ac-4430-92df-0f566d4c9ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:bb:fa', 'vm-uuid': '6aff3409-81c6-4c41-9a03-8f4abfb318c9'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: INFO os_vif [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05')
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeff47ecd-7f, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeff47ecd-7f, col_values=(('qos', UUID('b6c31aa4-f38c-461d-b41a-3821dbde6fa9')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeff47ecd-7f, col_values=(('external_ids', {'iface-id': 'eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:2e:6c', 'vm-uuid': '6040b882-4024-457a-8f26-8ee29cb54cc6'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:53 user nova-compute[75373]: INFO os_vif [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f')
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:76:bb:fa, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:20:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] No VIF found with MAC fa:16:3e:a3:2e:6c, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Successfully updated port: 36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Releasing lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Instance network_info: |[{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] Acquired lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Refreshing network info cache for port c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Start _get_guest_xml network_info=[{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:20:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888486235',display_name='tempest-ServersNegativeTestJSON-server-888486235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-888486235',id=2,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-rpb71aar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:46Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=7730c34d-5c8b-4f03-9a77-b24ce6244605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lazy-loading 'pci_devices' on Instance uuid 7730c34d-5c8b-4f03-9a77-b24ce6244605 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:20:54 user nova-compute[75373]:   <uuid>7730c34d-5c8b-4f03-9a77-b24ce6244605</uuid>
Nov 29 07:20:54 user nova-compute[75373]:   <name>instance-00000002</name>
Nov 29 07:20:54 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:20:54 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:20:54 user nova-compute[75373]:   <metadata>
Nov 29 07:20:54 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:20:54 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:name>tempest-ServersNegativeTestJSON-server-888486235</nova:name>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:20:54</nova:creationTime>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:20:54 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:20:54 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:owner>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:user uuid="1bc76bca5efd4f1aaf1250f9d63d1859">tempest-ServersNegativeTestJSON-1656759200-project-member</nova:user>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:project uuid="3c4071c6738f4509a906b090b5ffdb84">tempest-ServersNegativeTestJSON-1656759200</nova:project>
Nov 29 07:20:54 user nova-compute[75373]:       </nova:owner>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:20:54 user nova-compute[75373]:       <nova:ports>
Nov 29 07:20:54 user nova-compute[75373]:         <nova:port uuid="c620401f-da47-4341-9f82-c97ceea48d9e">
Nov 29 07:20:54 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:20:54 user nova-compute[75373]:         </nova:port>
Nov 29 07:20:54 user nova-compute[75373]:       </nova:ports>
Nov 29 07:20:54 user nova-compute[75373]:     </nova:instance>
Nov 29 07:20:54 user nova-compute[75373]:   </metadata>
Nov 29 07:20:54 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:20:54 user nova-compute[75373]:     <system>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="serial">7730c34d-5c8b-4f03-9a77-b24ce6244605</entry>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="uuid">7730c34d-5c8b-4f03-9a77-b24ce6244605</entry>
Nov 29 07:20:54 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:20:54 user nova-compute[75373]:     </system>
Nov 29 07:20:54 user nova-compute[75373]:   </sysinfo>
Nov 29 07:20:54 user nova-compute[75373]:   <os>
Nov 29 07:20:54 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:20:54 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:20:54 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:20:54 user nova-compute[75373]:   </os>
Nov 29 07:20:54 user nova-compute[75373]:   <features>
Nov 29 07:20:54 user nova-compute[75373]:     <acpi/>
Nov 29 07:20:54 user nova-compute[75373]:     <apic/>
Nov 29 07:20:54 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:20:54 user nova-compute[75373]:   </features>
Nov 29 07:20:54 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:20:54 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:20:54 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:20:54 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:20:54 user nova-compute[75373]:   </clock>
Nov 29 07:20:54 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:20:54 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:20:54 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:20:54 user nova-compute[75373]:   </cpu>
Nov 29 07:20:54 user nova-compute[75373]:   <devices>
Nov 29 07:20:54 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:20:54 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:20:54 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk"/>
Nov 29 07:20:54 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:20:54 user nova-compute[75373]:     </disk>
Nov 29 07:20:54 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:20:54 user nova-compute[75373]:       <mac address="fa:16:3e:4a:87:e8"/>
Nov 29 07:20:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:54 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:20:54 user nova-compute[75373]:       <target dev="tapc620401f-da"/>
Nov 29 07:20:54 user nova-compute[75373]:     </interface>
Nov 29 07:20:54 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:20:54 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/console.log" append="off"/>
Nov 29 07:20:54 user nova-compute[75373]:     </serial>
Nov 29 07:20:54 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:20:54 user nova-compute[75373]:     <video>
Nov 29 07:20:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:54 user nova-compute[75373]:     </video>
Nov 29 07:20:54 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:20:54 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:20:54 user nova-compute[75373]:     </rng>
Nov 29 07:20:54 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:20:54 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:20:54 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:20:54 user nova-compute[75373]:     </memballoon>
Nov 29 07:20:54 user nova-compute[75373]:   </devices>
Nov 29 07:20:54 user nova-compute[75373]: </domain>
Nov 29 07:20:54 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888486235',display_name='tempest-ServersNegativeTestJSON-server-888486235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-888486235',id=2,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-rpb71aar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:46Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=7730c34d-5c8b-4f03-9a77-b24ce6244605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG os_vif [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ead16564-f5cd-5a57-ad5e-e46f2e061ca5', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updated VIF entry in instance network info cache for port 1f6722af-05ac-4430-92df-0f566d4c9ef4. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-201097b7-cb98-44bd-b25e-446c2aa0cf9d req-01afa8ad-34bb-4268-9d01-5a5b5107e816 service nova] Releasing lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc620401f-da, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc620401f-da, col_values=(('qos', UUID('78bf913a-cfb7-4bb3-a369-862eb5b1dc67')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc620401f-da, col_values=(('external_ids', {'iface-id': 'c620401f-da47-4341-9f82-c97ceea48d9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:87:e8', 'vm-uuid': '7730c34d-5c8b-4f03-9a77-b24ce6244605'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:54 user nova-compute[75373]: INFO os_vif [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da')
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:20:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] No VIF found with MAC fa:16:3e:4a:87:e8, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Instance network_info: |[{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Start _get_guest_xml network_info=[{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:20:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-786024452',display_name='tempest-ServerActionsTestOtherA-server-786024452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-786024452',id=4,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-vu28zxcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=715c4151-deed-43c5-b786-6368742953d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.objects.instance [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'pci_devices' on Instance uuid 715c4151-deed-43c5-b786-6368742953d3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:20:55 user nova-compute[75373]:   <uuid>715c4151-deed-43c5-b786-6368742953d3</uuid>
Nov 29 07:20:55 user nova-compute[75373]:   <name>instance-00000004</name>
Nov 29 07:20:55 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:20:55 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:20:55 user nova-compute[75373]:   <metadata>
Nov 29 07:20:55 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:20:55 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherA-server-786024452</nova:name>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:20:55</nova:creationTime>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:20:55 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:owner>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:user uuid="fd3d603a0cab4a7da1c743c26b73540d">tempest-ServerActionsTestOtherA-1926007529-project-member</nova:user>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:project uuid="b3f10657321e44f49a30fedbe20dddcf">tempest-ServerActionsTestOtherA-1926007529</nova:project>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:owner>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:ports>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:port uuid="86bb9a6e-6e20-4552-8f0f-ca84e2995b21">
Nov 29 07:20:55 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:20:55 user nova-compute[75373]:         </nova:port>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:ports>
Nov 29 07:20:55 user nova-compute[75373]:     </nova:instance>
Nov 29 07:20:55 user nova-compute[75373]:   </metadata>
Nov 29 07:20:55 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:20:55 user nova-compute[75373]:     <system>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="serial">715c4151-deed-43c5-b786-6368742953d3</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="uuid">715c4151-deed-43c5-b786-6368742953d3</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:20:55 user nova-compute[75373]:     </system>
Nov 29 07:20:55 user nova-compute[75373]:   </sysinfo>
Nov 29 07:20:55 user nova-compute[75373]:   <os>
Nov 29 07:20:55 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:20:55 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:20:55 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:20:55 user nova-compute[75373]:   </os>
Nov 29 07:20:55 user nova-compute[75373]:   <features>
Nov 29 07:20:55 user nova-compute[75373]:     <acpi/>
Nov 29 07:20:55 user nova-compute[75373]:     <apic/>
Nov 29 07:20:55 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:20:55 user nova-compute[75373]:   </features>
Nov 29 07:20:55 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:20:55 user nova-compute[75373]:   </clock>
Nov 29 07:20:55 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:20:55 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:20:55 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:20:55 user nova-compute[75373]:   </cpu>
Nov 29 07:20:55 user nova-compute[75373]:   <devices>
Nov 29 07:20:55 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:20:55 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:20:55 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk"/>
Nov 29 07:20:55 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:     </disk>
Nov 29 07:20:55 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:20:55 user nova-compute[75373]:       <mac address="fa:16:3e:06:0a:92"/>
Nov 29 07:20:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:20:55 user nova-compute[75373]:       <target dev="tap86bb9a6e-6e"/>
Nov 29 07:20:55 user nova-compute[75373]:     </interface>
Nov 29 07:20:55 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:20:55 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/console.log" append="off"/>
Nov 29 07:20:55 user nova-compute[75373]:     </serial>
Nov 29 07:20:55 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:20:55 user nova-compute[75373]:     <video>
Nov 29 07:20:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:     </video>
Nov 29 07:20:55 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:20:55 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:20:55 user nova-compute[75373]:     </rng>
Nov 29 07:20:55 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:20:55 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:20:55 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:20:55 user nova-compute[75373]:     </memballoon>
Nov 29 07:20:55 user nova-compute[75373]:   </devices>
Nov 29 07:20:55 user nova-compute[75373]: </domain>
Nov 29 07:20:55 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-786024452',display_name='tempest-ServerActionsTestOtherA-server-786024452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-786024452',id=4,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-vu28zxcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=715c4151-deed-43c5-b786-6368742953d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG os_vif [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9be07e-0b68-58d5-8e87-fc4e26164c85', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86bb9a6e-6e, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86bb9a6e-6e, col_values=(('qos', UUID('da064686-bf28-442a-b69a-392bc2e4f47d')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86bb9a6e-6e, col_values=(('external_ids', {'iface-id': '86bb9a6e-6e20-4552-8f0f-ca84e2995b21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:0a:92', 'vm-uuid': '715c4151-deed-43c5-b786-6368742953d3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: INFO os_vif [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e')
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No VIF found with MAC fa:16:3e:06:0a:92, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance network_info: |[{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start _get_guest_xml network_info=[{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:20:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-357729244',display_name='tempest-ServerRescueNegativeTestJSON-server-357729244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-357729244',id=3,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-3n8vngq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:47Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=844be7c0-d83d-401f-9c62-bca197bf1683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:20:55 user nova-compute[75373]:   <uuid>844be7c0-d83d-401f-9c62-bca197bf1683</uuid>
Nov 29 07:20:55 user nova-compute[75373]:   <name>instance-00000003</name>
Nov 29 07:20:55 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:20:55 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:20:55 user nova-compute[75373]:   <metadata>
Nov 29 07:20:55 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:20:55 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-357729244</nova:name>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:20:55</nova:creationTime>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:20:55 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:owner>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:owner>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:20:55 user nova-compute[75373]:       <nova:ports>
Nov 29 07:20:55 user nova-compute[75373]:         <nova:port uuid="36fe1fea-00f2-41e9-9035-229c5d9222d6">
Nov 29 07:20:55 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:20:55 user nova-compute[75373]:         </nova:port>
Nov 29 07:20:55 user nova-compute[75373]:       </nova:ports>
Nov 29 07:20:55 user nova-compute[75373]:     </nova:instance>
Nov 29 07:20:55 user nova-compute[75373]:   </metadata>
Nov 29 07:20:55 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:20:55 user nova-compute[75373]:     <system>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="serial">844be7c0-d83d-401f-9c62-bca197bf1683</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="uuid">844be7c0-d83d-401f-9c62-bca197bf1683</entry>
Nov 29 07:20:55 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:20:55 user nova-compute[75373]:     </system>
Nov 29 07:20:55 user nova-compute[75373]:   </sysinfo>
Nov 29 07:20:55 user nova-compute[75373]:   <os>
Nov 29 07:20:55 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:20:55 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:20:55 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:20:55 user nova-compute[75373]:   </os>
Nov 29 07:20:55 user nova-compute[75373]:   <features>
Nov 29 07:20:55 user nova-compute[75373]:     <acpi/>
Nov 29 07:20:55 user nova-compute[75373]:     <apic/>
Nov 29 07:20:55 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:20:55 user nova-compute[75373]:   </features>
Nov 29 07:20:55 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:20:55 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:20:55 user nova-compute[75373]:   </clock>
Nov 29 07:20:55 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:20:55 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:20:55 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:20:55 user nova-compute[75373]:   </cpu>
Nov 29 07:20:55 user nova-compute[75373]:   <devices>
Nov 29 07:20:55 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:20:55 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:20:55 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk"/>
Nov 29 07:20:55 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:     </disk>
Nov 29 07:20:55 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:20:55 user nova-compute[75373]:       <mac address="fa:16:3e:a1:da:97"/>
Nov 29 07:20:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:20:55 user nova-compute[75373]:       <target dev="tap36fe1fea-00"/>
Nov 29 07:20:55 user nova-compute[75373]:     </interface>
Nov 29 07:20:55 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:20:55 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/console.log" append="off"/>
Nov 29 07:20:55 user nova-compute[75373]:     </serial>
Nov 29 07:20:55 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:20:55 user nova-compute[75373]:     <video>
Nov 29 07:20:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:20:55 user nova-compute[75373]:     </video>
Nov 29 07:20:55 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:20:55 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:20:55 user nova-compute[75373]:     </rng>
Nov 29 07:20:55 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:20:55 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:20:55 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:20:55 user nova-compute[75373]:     </memballoon>
Nov 29 07:20:55 user nova-compute[75373]:   </devices>
Nov 29 07:20:55 user nova-compute[75373]: </domain>
Nov 29 07:20:55 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-357729244',display_name='tempest-ServerRescueNegativeTestJSON-server-357729244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-357729244',id=3,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-3n8vngq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:20:47Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=844be7c0-d83d-401f-9c62-bca197bf1683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG os_vif [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a2e757-2cf0-5b41-abcb-355c85ed67d8', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36fe1fea-00, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36fe1fea-00, col_values=(('qos', UUID('ba597204-1f5f-469a-b7d8-bf7285c4d964')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36fe1fea-00, col_values=(('external_ids', {'iface-id': '36fe1fea-00f2-41e9-9035-229c5d9222d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:da:97', 'vm-uuid': '844be7c0-d83d-401f-9c62-bca197bf1683'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-changed-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Refreshing instance network info cache due to event network-changed-36fe1fea-00f2-41e9-9035-229c5d9222d6. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Refreshing network info cache for port 36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:55 user nova-compute[75373]: INFO os_vif [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00')
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:20:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:a1:da:97, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updated VIF entry in instance network info cache for port c620401f-da47-4341-9f82-c97ceea48d9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-284197ac-6784-4eb0-a2a0-adae0bed957f req-b210456d-ddcd-46ac-b384-7ef67d6d7075 service nova] Releasing lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated VIF entry in instance network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4448d6db-4016-4681-b63a-5ff5539091d0 req-1dbc7e3f-58f7-4ea2-9c77-370433e95df2 service nova] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:57 user nova-compute[75373]: DEBUG nova.network.neutron [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updated VIF entry in instance network info cache for port 36fe1fea-00f2-41e9-9035-229c5d9222d6. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:20:57 user nova-compute[75373]: DEBUG nova.network.neutron [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:20:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e7c7cd2e-203a-413d-91e8-4b705fb569bb req-6b7a67fd-8c8c-49be-bf3a-8a46d782b53a service nova] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:20:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:20:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.compute.claims [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Claim successful on node user
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance spawned successfully.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Took 16.37 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Instance spawned successfully.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.compute.manager [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Took 17.55 seconds to build instance.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-74ef7e4c-47a3-4261-903e-10c2c1db85f5 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.707s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Took 19.86 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.compute.manager [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Took 20.86 seconds to build instance.
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance spawned successfully.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] Instance spawned successfully.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.643s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ea7ba395-0b38-4101-86fa-68458cfddd33 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.175s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Instance spawned successfully.
Nov 29 07:21:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Took 18.16 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Took 18.21 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.compute.manager [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Took 19.47 seconds to build instance.
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.policy [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbaeb2f9fc3749fb859df41acc075df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af9d0f931c24042a73455a7ac45e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cdb72173-da21-44a2-bc67-492e5e5d1bdf tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.647s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Took 19.85 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Creating image(s)
Nov 29 07:21:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "/opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "/opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "/opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:05 user nova-compute[75373]: INFO nova.compute.manager [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Took 21.24 seconds to build instance.
Nov 29 07:21:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4281cf8e-058f-4de4-9bf5-d87fe3276010 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.418s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:06 user nova-compute[75373]: INFO nova.compute.manager [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Took 19.64 seconds to build instance.
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-125f6fe9-579e-4e0d-a01f-37ad707aadc2 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.908s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.307s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.263s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk 1073741824" returned: 0 in 0.088s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.329s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:21:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Cannot resize image /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Ensure instance console log exists: /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:08 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Successfully created port: 47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Successfully updated port: 47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquired lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-changed-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Refreshing instance network info cache due to event network-changed-47aff5a9-b99d-4805-afc7-fea4aa29f673. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] Acquiring lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating instance_info_cache with network_info: [{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Releasing lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Instance network_info: |[{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] Acquired lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Refreshing network info cache for port 47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Start _get_guest_xml network_info=[{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-193948682',display_name='tempest-VolumesAdminNegativeTest-server-193948682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-193948682',id=6,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeE3AK/Nc+FLZ+vieZU1JgXf6yICUfxZyxRA/xcupW8LxXlMpkJMaL7L9svGHl3aZ/mHzeoECLc8t1iSQzwRgt+BGWldKWkzTsZVwwQ6R763qz10O9WuFhdzbNQQ9P9TA==',key_name='tempest-keypair-1264636496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-5005up49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=b791f041-3d5e-4f5f-b354-3651b9238077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'pci_devices' on Instance uuid b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:12 user nova-compute[75373]:   <uuid>b791f041-3d5e-4f5f-b354-3651b9238077</uuid>
Nov 29 07:21:12 user nova-compute[75373]:   <name>instance-00000006</name>
Nov 29 07:21:12 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:12 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:12 user nova-compute[75373]:   <metadata>
Nov 29 07:21:12 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:12 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:name>tempest-VolumesAdminNegativeTest-server-193948682</nova:name>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:11</nova:creationTime>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:12 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:12 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:user uuid="cbaeb2f9fc3749fb859df41acc075df2">tempest-VolumesAdminNegativeTest-1139418558-project-member</nova:user>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:project uuid="6af9d0f931c24042a73455a7ac45e87d">tempest-VolumesAdminNegativeTest-1139418558</nova:project>
Nov 29 07:21:12 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:21:12 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:12 user nova-compute[75373]:         <nova:port uuid="47aff5a9-b99d-4805-afc7-fea4aa29f673">
Nov 29 07:21:12 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 07:21:12 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:12 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:12 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:12 user nova-compute[75373]:   </metadata>
Nov 29 07:21:12 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:12 user nova-compute[75373]:     <system>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="serial">b791f041-3d5e-4f5f-b354-3651b9238077</entry>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="uuid">b791f041-3d5e-4f5f-b354-3651b9238077</entry>
Nov 29 07:21:12 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:12 user nova-compute[75373]:     </system>
Nov 29 07:21:12 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:12 user nova-compute[75373]:   <os>
Nov 29 07:21:12 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:12 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:12 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:12 user nova-compute[75373]:   </os>
Nov 29 07:21:12 user nova-compute[75373]:   <features>
Nov 29 07:21:12 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:12 user nova-compute[75373]:     <apic/>
Nov 29 07:21:12 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:12 user nova-compute[75373]:   </features>
Nov 29 07:21:12 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:12 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:12 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:12 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:12 user nova-compute[75373]:   </clock>
Nov 29 07:21:12 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:12 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:12 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:12 user nova-compute[75373]:   </cpu>
Nov 29 07:21:12 user nova-compute[75373]:   <devices>
Nov 29 07:21:12 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:21:12 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:21:12 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk"/>
Nov 29 07:21:12 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:21:12 user nova-compute[75373]:     </disk>
Nov 29 07:21:12 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:12 user nova-compute[75373]:       <mac address="fa:16:3e:17:d8:78"/>
Nov 29 07:21:12 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:12 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:12 user nova-compute[75373]:       <target dev="tap47aff5a9-b9"/>
Nov 29 07:21:12 user nova-compute[75373]:     </interface>
Nov 29 07:21:12 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:12 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/console.log" append="off"/>
Nov 29 07:21:12 user nova-compute[75373]:     </serial>
Nov 29 07:21:12 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:12 user nova-compute[75373]:     <video>
Nov 29 07:21:12 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:12 user nova-compute[75373]:     </video>
Nov 29 07:21:12 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:12 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:12 user nova-compute[75373]:     </rng>
Nov 29 07:21:12 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:12 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:12 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:12 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:12 user nova-compute[75373]:   </devices>
Nov 29 07:21:12 user nova-compute[75373]: </domain>
Nov 29 07:21:12 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-193948682',display_name='tempest-VolumesAdminNegativeTest-server-193948682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-193948682',id=6,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeE3AK/Nc+FLZ+vieZU1JgXf6yICUfxZyxRA/xcupW8LxXlMpkJMaL7L9svGHl3aZ/mHzeoECLc8t1iSQzwRgt+BGWldKWkzTsZVwwQ6R763qz10O9WuFhdzbNQQ9P9TA==',key_name='tempest-keypair-1264636496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-5005up49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=b791f041-3d5e-4f5f-b354-3651b9238077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG os_vif [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '454bdc01-adc7-50ac-9f94-4d8de45f0040', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:12 user nova-compute[75373]: INFO nova.compute.claims [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Claim successful on node user
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47aff5a9-b9, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47aff5a9-b9, col_values=(('qos', UUID('dbcd4163-f646-4c90-b70b-0380d298ff12')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47aff5a9-b9, col_values=(('external_ids', {'iface-id': '47aff5a9-b99d-4805-afc7-fea4aa29f673', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:d8:78', 'vm-uuid': 'b791f041-3d5e-4f5f-b354-3651b9238077'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: INFO os_vif [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9')
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No VIF found with MAC fa:16:3e:17:d8:78, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updated VIF entry in instance network info cache for port 47aff5a9-b99d-4805-afc7-fea4aa29f673. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating instance_info_cache with network_info: [{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b4af68-9d5e-4b6b-96c0-c3bb8320ab85 req-b733422a-9352-4afc-ba31-20e5951d22ad service nova] Releasing lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.141s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.147s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:13 user nova-compute[75373]: INFO nova.compute.claims [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Claim successful on node user
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.policy [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b584f0452cb44e3ba79b912176e27d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcc8f8d1bf747caa1265b18865e504e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Creating image(s)
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "23eca19a4145123bc68c894151a80c1f5aa474d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "23eca19a4145123bc68c894151a80c1f5aa474d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:13 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.183s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.976s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:14 user nova-compute[75373]: INFO nova.compute.claims [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Claim successful on node user
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.part --force-share --output=json" returned: 0 in 0.303s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.virt.images [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] 9c92d010-7b8e-456c-8fa3-8fa20dd12870 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.part /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:14 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.policy [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b8794171dae42239ca57e9a36182ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fdf48c94fd4557ad3f5f3a59c8726b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Successfully created port: 7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.part /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.converted" returned: 0 in 0.321s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Creating image(s)
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.280s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0.converted --force-share --output=json" returned: 0 in 0.491s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "23eca19a4145123bc68c894151a80c1f5aa474d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.770s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.425s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.453s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk 1073741824" returned: 0 in 0.093s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.521s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json" returned: 0 in 0.458s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "23eca19a4145123bc68c894151a80c1f5aa474d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "23eca19a4145123bc68c894151a80c1f5aa474d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.320s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json" returned: 0 in 0.341s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0,backing_fmt=raw /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Creating image(s)
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "/opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "/opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "/opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0,backing_fmt=raw /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk 1073741824" returned: 0 in 0.129s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "23eca19a4145123bc68c894151a80c1f5aa474d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Cannot resize image /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Ensure instance console log exists: /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.policy [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b85936f1d9142fd98ae1dde5de52c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd073ebee56448bfa0ba92d9f0788ab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.233s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0 --force-share --output=json" returned: 0 in 0.289s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:21:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Successfully created port: 7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.314s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk 1073741824" returned: 0 in 0.097s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.421s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Cannot resize image /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Ensure instance console log exists: /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.299s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Instance spawned successfully.
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Cannot resize image /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Ensure instance console log exists: /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Successfully updated port: 7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:17 user nova-compute[75373]: INFO nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Took 11.98 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquired lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-changed-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Refreshing instance network info cache due to event network-changed-7f395be8-0836-4f70-8d99-8c9a1ea95d07. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] Acquiring lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:18 user nova-compute[75373]: INFO nova.compute.manager [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Took 14.96 seconds to build instance.
Nov 29 07:21:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3266e625-1d05-4dcc-817d-a30318e37e8e tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.142s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Successfully updated port: 7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-changed-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing instance network info cache due to event network-changed-7370770a-61cd-4282-aff1-a6c5fa9bb065. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Successfully created port: 267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Instance network_info: |[{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.neutron [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing network info cache for port 7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Start _get_guest_xml network_info=[{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updating instance_info_cache with network_info: [{"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:19 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:19 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.objects.instance [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'pci_devices' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Releasing lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Instance network_info: |[{"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] Acquired lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.neutron [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Refreshing network info cache for port 7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Start _get_guest_xml network_info=[{"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:21:00Z,direct_url=<?>,disk_format='qcow2',id=9c92d010-7b8e-456c-8fa3-8fa20dd12870,min_disk=0,min_ram=0,name='',owner='9315d24aadc04da9abe7905458ddc584',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:21:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '9c92d010-7b8e-456c-8fa3-8fa20dd12870'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:19 user nova-compute[75373]:   <uuid>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</uuid>
Nov 29 07:21:19 user nova-compute[75373]:   <name>instance-00000008</name>
Nov 29 07:21:19 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:19 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:19 user nova-compute[75373]:   <metadata>
Nov 29 07:21:19 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:19 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:19</nova:creationTime>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:19 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:21:19 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:21:19 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:19 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:19 user nova-compute[75373]:   </metadata>
Nov 29 07:21:19 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:19 user nova-compute[75373]:     <system>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="serial">d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="uuid">d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:19 user nova-compute[75373]:     </system>
Nov 29 07:21:19 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:19 user nova-compute[75373]:   <os>
Nov 29 07:21:19 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:19 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:19 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:19 user nova-compute[75373]:   </os>
Nov 29 07:21:19 user nova-compute[75373]:   <features>
Nov 29 07:21:19 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:19 user nova-compute[75373]:     <apic/>
Nov 29 07:21:19 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:19 user nova-compute[75373]:   </features>
Nov 29 07:21:19 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:19 user nova-compute[75373]:   </clock>
Nov 29 07:21:19 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:19 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:19 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:19 user nova-compute[75373]:   </cpu>
Nov 29 07:21:19 user nova-compute[75373]:   <devices>
Nov 29 07:21:19 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:21:19 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:21:19 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:21:19 user nova-compute[75373]:     </disk>
Nov 29 07:21:19 user nova-compute[75373]:     <disk type="file" device="cdrom">
Nov 29 07:21:19 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 07:21:19 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="hda" bus="ide"/>
Nov 29 07:21:19 user nova-compute[75373]:     </disk>
Nov 29 07:21:19 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:19 user nova-compute[75373]:       <mac address="fa:16:3e:9a:d0:ac"/>
Nov 29 07:21:19 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:19 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="tap7370770a-61"/>
Nov 29 07:21:19 user nova-compute[75373]:     </interface>
Nov 29 07:21:19 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:19 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log" append="off"/>
Nov 29 07:21:19 user nova-compute[75373]:     </serial>
Nov 29 07:21:19 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:19 user nova-compute[75373]:     <video>
Nov 29 07:21:19 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:19 user nova-compute[75373]:     </video>
Nov 29 07:21:19 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:19 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:19 user nova-compute[75373]:     </rng>
Nov 29 07:21:19 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:19 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:19 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:19 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:19 user nova-compute[75373]:   </devices>
Nov 29 07:21:19 user nova-compute[75373]: </domain>
Nov 29 07:21:19 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG os_vif [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbfc0054-4082-5293-939d-9d019a5d322f', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:19 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:19 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7370770a-61, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7370770a-61, col_values=(('qos', UUID('83d1e116-02e9-459c-a460-f8bf4ae8c9cd')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7370770a-61, col_values=(('external_ids', {'iface-id': '7370770a-61cd-4282-aff1-a6c5fa9bb065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d0:ac', 'vm-uuid': 'd5f12e85-8ea5-4a78-85c3-c5bf2ad62951'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:21:00Z,direct_url=<?>,disk_format='qcow2',id=9c92d010-7b8e-456c-8fa3-8fa20dd12870,min_disk=0,min_ram=0,name='',owner='9315d24aadc04da9abe7905458ddc584',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:21:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427904507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427904507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427904507',id=7,image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4v6gZQnUDyKQLRoXZS1+MjzR4HkIpns1jVjwWAkXgT0sJgX2Kr+1ZAxbZmlLahUm8mCuvt64m4UbpQ0NtzuOzSPvx8ooAXK4jTRf57FmlCmrGm+AvX69OuzcS/llQzg==',key_name='tempest-keypair-345467278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bcc8f8d1bf747caa1265b18865e504e',ramdisk_id='',reservation_id='r-mhfmugyh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1327160197',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1327160197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b584f0452cb44e3ba79b912176e27d1e',uuid=a0bb9854-023a-4f26-98e5-5e8e9209c696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converting VIF {"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lazy-loading 'pci_devices' on Instance uuid a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: INFO os_vif [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61')
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:19 user nova-compute[75373]:   <uuid>a0bb9854-023a-4f26-98e5-5e8e9209c696</uuid>
Nov 29 07:21:19 user nova-compute[75373]:   <name>instance-00000007</name>
Nov 29 07:21:19 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:19 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:19 user nova-compute[75373]:   <metadata>
Nov 29 07:21:19 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:19 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1427904507</nova:name>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:19</nova:creationTime>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:19 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:user uuid="b584f0452cb44e3ba79b912176e27d1e">tempest-AttachSCSIVolumeTestJSON-1327160197-project-member</nova:user>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:project uuid="1bcc8f8d1bf747caa1265b18865e504e">tempest-AttachSCSIVolumeTestJSON-1327160197</nova:project>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:root type="image" uuid="9c92d010-7b8e-456c-8fa3-8fa20dd12870"/>
Nov 29 07:21:19 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:19 user nova-compute[75373]:         <nova:port uuid="7f395be8-0836-4f70-8d99-8c9a1ea95d07">
Nov 29 07:21:19 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 07:21:19 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:19 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:19 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:19 user nova-compute[75373]:   </metadata>
Nov 29 07:21:19 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:19 user nova-compute[75373]:     <system>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="serial">a0bb9854-023a-4f26-98e5-5e8e9209c696</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="uuid">a0bb9854-023a-4f26-98e5-5e8e9209c696</entry>
Nov 29 07:21:19 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:19 user nova-compute[75373]:     </system>
Nov 29 07:21:19 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:19 user nova-compute[75373]:   <os>
Nov 29 07:21:19 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:19 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:19 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:19 user nova-compute[75373]:   </os>
Nov 29 07:21:19 user nova-compute[75373]:   <features>
Nov 29 07:21:19 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:19 user nova-compute[75373]:     <apic/>
Nov 29 07:21:19 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:19 user nova-compute[75373]:   </features>
Nov 29 07:21:19 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:19 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:19 user nova-compute[75373]:   </clock>
Nov 29 07:21:19 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:19 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:19 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:19 user nova-compute[75373]:   </cpu>
Nov 29 07:21:19 user nova-compute[75373]:   <devices>
Nov 29 07:21:19 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:21:19 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:21:19 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="sda" bus="scsi"/>
Nov 29 07:21:19 user nova-compute[75373]:       <address type="drive" controller="0" unit="0"/>
Nov 29 07:21:19 user nova-compute[75373]:     </disk>
Nov 29 07:21:19 user nova-compute[75373]:     <disk type="file" device="cdrom">
Nov 29 07:21:19 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 07:21:19 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.config"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="sdb" bus="scsi"/>
Nov 29 07:21:19 user nova-compute[75373]:       <address type="drive" controller="0" unit="1"/>
Nov 29 07:21:19 user nova-compute[75373]:     </disk>
Nov 29 07:21:19 user nova-compute[75373]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 07:21:19 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:19 user nova-compute[75373]:       <mac address="fa:16:3e:aa:14:d0"/>
Nov 29 07:21:19 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:19 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:19 user nova-compute[75373]:       <target dev="tap7f395be8-08"/>
Nov 29 07:21:19 user nova-compute[75373]:     </interface>
Nov 29 07:21:19 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:19 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/console.log" append="off"/>
Nov 29 07:21:19 user nova-compute[75373]:     </serial>
Nov 29 07:21:19 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:19 user nova-compute[75373]:     <video>
Nov 29 07:21:19 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:19 user nova-compute[75373]:     </video>
Nov 29 07:21:19 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:19 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:19 user nova-compute[75373]:     </rng>
Nov 29 07:21:19 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:19 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:19 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:19 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:19 user nova-compute[75373]:   </devices>
Nov 29 07:21:19 user nova-compute[75373]: </domain>
Nov 29 07:21:19 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427904507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427904507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427904507',id=7,image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4v6gZQnUDyKQLRoXZS1+MjzR4HkIpns1jVjwWAkXgT0sJgX2Kr+1ZAxbZmlLahUm8mCuvt64m4UbpQ0NtzuOzSPvx8ooAXK4jTRf57FmlCmrGm+AvX69OuzcS/llQzg==',key_name='tempest-keypair-345467278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bcc8f8d1bf747caa1265b18865e504e',ramdisk_id='',reservation_id='r-mhfmugyh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1327160197',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1327160197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b584f0452cb44e3ba79b912176e27d1e',uuid=a0bb9854-023a-4f26-98e5-5e8e9209c696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converting VIF {"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG os_vif [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a32e4b23-540e-5e71-a2dd-2e63e7407698', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f395be8-08, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f395be8-08, col_values=(('qos', UUID('ef9025dc-e827-4eeb-a08a-eb8555eeca72')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f395be8-08, col_values=(('external_ids', {'iface-id': '7f395be8-0836-4f70-8d99-8c9a1ea95d07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:14:d0', 'vm-uuid': 'a0bb9854-023a-4f26-98e5-5e8e9209c696'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:19 user nova-compute[75373]: INFO os_vif [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08')
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name hda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No VIF found with MAC fa:16:3e:9a:d0:ac, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Using config drive
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No BDM found with device name sda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No VIF found with MAC fa:16:3e:aa:14:d0, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Using config drive
Nov 29 07:21:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Successfully updated port: 267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquired lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-changed-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Refreshing instance network info cache due to event network-changed-267199ca-0c64-4c5e-855c-538cb80aeba8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] Acquiring lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Creating config drive at /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprlmovh32 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprlmovh32" returned: 0 in 0.095s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updated VIF entry in instance network info cache for port 7f395be8-0836-4f70-8d99-8c9a1ea95d07. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updating instance_info_cache with network_info: [{"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0979fee-0dbf-40ba-8bb2-a2f1a13ccef3 req-a118fdae-c61f-4bd2-9a9a-b3a663008798 service nova] Releasing lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Creating config drive at /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.config
Nov 29 07:21:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0otrywzb {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updated VIF entry in instance network info cache for port 7370770a-61cd-4282-aff1-a6c5fa9bb065. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updating instance_info_cache with network_info: [{"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0otrywzb" returned: 0 in 0.081s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d0382349-c73d-4700-9a4e-882e3a1652f8 req-c94c59ee-fd5c-4e5d-8b54-7e8d42ef7931 service nova] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Releasing lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Instance network_info: |[{"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] Acquired lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Refreshing network info cache for port 267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Start _get_guest_xml network_info=[{"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:21 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:21 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1021309039',display_name='tempest-TestVolumeSwap-server-1021309039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1021309039',id=9,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCyv4lrIrWMhWwPyOkIxueUHQdDzwrhAxTXIkMexKzGQQECDEvr9CAe1a3e1IwwganqYTOzabfsDXew3AJNX1zi8tT/Qv3xAJx4XsyanEaIMjP9tZF7Nwp3FIvBhve8wg==',key_name='tempest-keypair-2106273125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd073ebee56448bfa0ba92d9f0788ab9',ramdisk_id='',reservation_id='r-63gphlob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1865011421',owner_user_name='tempest-TestVolumeSwap-1865011421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b85936f1d9142fd98ae1dde5de52c7e',uuid=9eeeba70-7aba-4471-8bd8-6710fc3f5c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converting VIF {"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lazy-loading 'pci_devices' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:21 user nova-compute[75373]:   <uuid>9eeeba70-7aba-4471-8bd8-6710fc3f5c17</uuid>
Nov 29 07:21:21 user nova-compute[75373]:   <name>instance-00000009</name>
Nov 29 07:21:21 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:21 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:21 user nova-compute[75373]:   <metadata>
Nov 29 07:21:21 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:21 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:name>tempest-TestVolumeSwap-server-1021309039</nova:name>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:21</nova:creationTime>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:21 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:21 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:user uuid="4b85936f1d9142fd98ae1dde5de52c7e">tempest-TestVolumeSwap-1865011421-project-member</nova:user>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:project uuid="dd073ebee56448bfa0ba92d9f0788ab9">tempest-TestVolumeSwap-1865011421</nova:project>
Nov 29 07:21:21 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:21:21 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:21 user nova-compute[75373]:         <nova:port uuid="267199ca-0c64-4c5e-855c-538cb80aeba8">
Nov 29 07:21:21 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:21:21 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:21 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:21 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:21 user nova-compute[75373]:   </metadata>
Nov 29 07:21:21 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:21 user nova-compute[75373]:     <system>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="serial">9eeeba70-7aba-4471-8bd8-6710fc3f5c17</entry>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="uuid">9eeeba70-7aba-4471-8bd8-6710fc3f5c17</entry>
Nov 29 07:21:21 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:21 user nova-compute[75373]:     </system>
Nov 29 07:21:21 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:21 user nova-compute[75373]:   <os>
Nov 29 07:21:21 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:21 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:21 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:21 user nova-compute[75373]:   </os>
Nov 29 07:21:21 user nova-compute[75373]:   <features>
Nov 29 07:21:21 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:21 user nova-compute[75373]:     <apic/>
Nov 29 07:21:21 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:21 user nova-compute[75373]:   </features>
Nov 29 07:21:21 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:21 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:21 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:21 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:21 user nova-compute[75373]:   </clock>
Nov 29 07:21:21 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:21 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:21 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:21 user nova-compute[75373]:   </cpu>
Nov 29 07:21:21 user nova-compute[75373]:   <devices>
Nov 29 07:21:21 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:21:21 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:21:21 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk"/>
Nov 29 07:21:21 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:21:21 user nova-compute[75373]:     </disk>
Nov 29 07:21:21 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:21 user nova-compute[75373]:       <mac address="fa:16:3e:cf:7e:47"/>
Nov 29 07:21:21 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:21 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:21 user nova-compute[75373]:       <target dev="tap267199ca-0c"/>
Nov 29 07:21:21 user nova-compute[75373]:     </interface>
Nov 29 07:21:21 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:21 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/console.log" append="off"/>
Nov 29 07:21:21 user nova-compute[75373]:     </serial>
Nov 29 07:21:21 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:21 user nova-compute[75373]:     <video>
Nov 29 07:21:21 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:21 user nova-compute[75373]:     </video>
Nov 29 07:21:21 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:21 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:21 user nova-compute[75373]:     </rng>
Nov 29 07:21:21 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:21 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:21 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:21 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:21 user nova-compute[75373]:   </devices>
Nov 29 07:21:21 user nova-compute[75373]: </domain>
Nov 29 07:21:21 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1021309039',display_name='tempest-TestVolumeSwap-server-1021309039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1021309039',id=9,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCyv4lrIrWMhWwPyOkIxueUHQdDzwrhAxTXIkMexKzGQQECDEvr9CAe1a3e1IwwganqYTOzabfsDXew3AJNX1zi8tT/Qv3xAJx4XsyanEaIMjP9tZF7Nwp3FIvBhve8wg==',key_name='tempest-keypair-2106273125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd073ebee56448bfa0ba92d9f0788ab9',ramdisk_id='',reservation_id='r-63gphlob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1865011421',owner_user_name='tempest-TestVolumeSwap-1865011421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b85936f1d9142fd98ae1dde5de52c7e',uuid=9eeeba70-7aba-4471-8bd8-6710fc3f5c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converting VIF {"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG os_vif [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87fb2f20-a0d3-5c9f-a4b7-576af0e3379a', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267199ca-0c, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap267199ca-0c, col_values=(('qos', UUID('cfeccf37-ec66-490e-b6b0-c8682932245e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap267199ca-0c, col_values=(('external_ids', {'iface-id': '267199ca-0c64-4c5e-855c-538cb80aeba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:7e:47', 'vm-uuid': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:21 user nova-compute[75373]: INFO os_vif [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c')
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] No VIF found with MAC fa:16:3e:cf:7e:47, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updated VIF entry in instance network info cache for port 267199ca-0c64-4c5e-855c-538cb80aeba8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updating instance_info_cache with network_info: [{"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d9e818ca-e682-486c-8a9b-b49ad7d6f20c req-fca885e0-a319-49e5-819a-3ba02a220505 service nova] Releasing lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:22 user nova-compute[75373]: INFO nova.compute.claims [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Claim successful on node user
Nov 29 07:21:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:22 user nova-compute[75373]: WARNING nova.compute.manager [req-723a17d2-be6a-4fc1-a75a-6e282b37eaf4 req-a2665481-55a0-4c8e-8620-a780453869b3 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state None.
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] No waiting events found dispatching network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:23 user nova-compute[75373]: WARNING nova.compute.manager [req-836677f1-7024-4968-8d70-8f5509213c8b req-af15c9aa-8172-45e2-9154-5a0d390d5cef service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received unexpected event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 for instance with vm_state active and task_state None.
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.038s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.policy [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3af2dcba2de142a3956137ceeef8ee5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '719e066d33ad4729aecc4463fd30b424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Creating image(s)
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "/opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "/opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "/opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.297s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.264s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk 1073741824" returned: 0 in 0.159s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.280s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:21:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] No waiting events found dispatching network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received unexpected event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] No waiting events found dispatching network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-09e1f66c-aed5-43ce-bfa3-a1793a7b0c87 req-cc84a7e3-2bc3-440e-a795-3f699a7332cc service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received unexpected event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Cannot resize image /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Ensure instance console log exists: /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] No waiting events found dispatching network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received unexpected event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:25 user nova-compute[75373]: WARNING nova.compute.manager [req-bccd6659-09b3-4d4c-94db-6b71837719e3 req-fbe2043d-aa78-460d-9f2f-f0a2ea7a6546 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state None.
Nov 29 07:21:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Successfully created port: ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] No waiting events found dispatching network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:26 user nova-compute[75373]: WARNING nova.compute.manager [req-bcb2560c-f809-46b6-9852-0bf1098afe91 req-76fe2695-2796-48b0-9c88-5c8aeb4aeb84 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received unexpected event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 for instance with vm_state active and task_state None.
Nov 29 07:21:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:26 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:21:26 user nova-compute[75373]: INFO nova.compute.claims [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Claim successful on node user
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] No waiting events found dispatching network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received unexpected event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 for instance with vm_state active and task_state None.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] No waiting events found dispatching network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received unexpected event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 for instance with vm_state active and task_state None.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 for instance with vm_state building and task_state spawning.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 for instance with vm_state building and task_state spawning.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] No waiting events found dispatching network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.compute.manager [req-37489065-420e-424f-98b8-e9092d8a3cbf req-7e1edc19-4735-482f-b1bc-ebf133157212 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received unexpected event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 for instance with vm_state building and task_state spawning.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Successfully updated port: ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquired lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:21:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.policy [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4923a7b67f843fd962dcb7df6e26e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb1f69b2da347f59a3b3db01e2af757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:21:27 user nova-compute[75373]: INFO nova.virt.block_device [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Booting with volume e6660b83-f4e1-4cef-9d0c-bba9d56e4748 at /dev/vda
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updating instance_info_cache with network_info: [{"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG os_brick.utils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:21:27 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0tat4u2b/privsep.sock']
Nov 29 07:21:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Releasing lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Instance network_info: |[{"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Start _get_guest_xml network_info=[{"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:27 user sudo[86287]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0tat4u2b/privsep.sock
Nov 29 07:21:27 user sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:27 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-637812550',display_name='tempest-VolumesAssistedSnapshotsTest-server-637812550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-637812550',id=10,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD29z5YGe2lyZDQFGIKNsbuqcB/pik7E4ieYcHIgzO9ZIv7kBp4m4aC+82qUXNpUyK2LAd+vp1i+fq+B4JGOoZkJpbI040eQCzQHrCGNYnrgsqEY5WHVmYow7XGN46aOBg==',key_name='tempest-keypair-788485080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='719e066d33ad4729aecc4463fd30b424',ramdisk_id='',reservation_id='r-4dqfpi8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-871024869',owner_user_name='tempest-VolumesAssistedSnapshotsTest-871024869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af2dcba2de142a3956137ceeef8ee5a',uuid=426b9987-09a0-4c2a-8a51-7cc528b1b5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converting VIF {"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lazy-loading 'pci_devices' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:27 user nova-compute[75373]:   <uuid>426b9987-09a0-4c2a-8a51-7cc528b1b5e3</uuid>
Nov 29 07:21:27 user nova-compute[75373]:   <name>instance-0000000a</name>
Nov 29 07:21:27 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:27 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:27 user nova-compute[75373]:   <metadata>
Nov 29 07:21:27 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:27 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-637812550</nova:name>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:27</nova:creationTime>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:27 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:27 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:user uuid="3af2dcba2de142a3956137ceeef8ee5a">tempest-VolumesAssistedSnapshotsTest-871024869-project-member</nova:user>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:project uuid="719e066d33ad4729aecc4463fd30b424">tempest-VolumesAssistedSnapshotsTest-871024869</nova:project>
Nov 29 07:21:27 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:21:27 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:27 user nova-compute[75373]:         <nova:port uuid="ecc24501-f3af-41e1-a92d-a3b6a7cd5b91">
Nov 29 07:21:27 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 07:21:27 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:27 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:27 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:27 user nova-compute[75373]:   </metadata>
Nov 29 07:21:27 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:27 user nova-compute[75373]:     <system>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="serial">426b9987-09a0-4c2a-8a51-7cc528b1b5e3</entry>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="uuid">426b9987-09a0-4c2a-8a51-7cc528b1b5e3</entry>
Nov 29 07:21:27 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:27 user nova-compute[75373]:     </system>
Nov 29 07:21:27 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:27 user nova-compute[75373]:   <os>
Nov 29 07:21:27 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:27 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:27 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:27 user nova-compute[75373]:   </os>
Nov 29 07:21:27 user nova-compute[75373]:   <features>
Nov 29 07:21:27 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:27 user nova-compute[75373]:     <apic/>
Nov 29 07:21:27 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:27 user nova-compute[75373]:   </features>
Nov 29 07:21:27 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:27 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:27 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:27 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:27 user nova-compute[75373]:   </clock>
Nov 29 07:21:27 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:27 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:27 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:27 user nova-compute[75373]:   </cpu>
Nov 29 07:21:27 user nova-compute[75373]:   <devices>
Nov 29 07:21:27 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:21:27 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:21:27 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk"/>
Nov 29 07:21:27 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:21:27 user nova-compute[75373]:     </disk>
Nov 29 07:21:27 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:27 user nova-compute[75373]:       <mac address="fa:16:3e:80:be:83"/>
Nov 29 07:21:27 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:27 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:27 user nova-compute[75373]:       <target dev="tapecc24501-f3"/>
Nov 29 07:21:27 user nova-compute[75373]:     </interface>
Nov 29 07:21:27 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:27 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/console.log" append="off"/>
Nov 29 07:21:27 user nova-compute[75373]:     </serial>
Nov 29 07:21:27 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:27 user nova-compute[75373]:     <video>
Nov 29 07:21:27 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:27 user nova-compute[75373]:     </video>
Nov 29 07:21:27 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:27 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:27 user nova-compute[75373]:     </rng>
Nov 29 07:21:27 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:27 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:27 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:27 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:27 user nova-compute[75373]:   </devices>
Nov 29 07:21:27 user nova-compute[75373]: </domain>
Nov 29 07:21:27 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-637812550',display_name='tempest-VolumesAssistedSnapshotsTest-server-637812550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-637812550',id=10,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD29z5YGe2lyZDQFGIKNsbuqcB/pik7E4ieYcHIgzO9ZIv7kBp4m4aC+82qUXNpUyK2LAd+vp1i+fq+B4JGOoZkJpbI040eQCzQHrCGNYnrgsqEY5WHVmYow7XGN46aOBg==',key_name='tempest-keypair-788485080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='719e066d33ad4729aecc4463fd30b424',ramdisk_id='',reservation_id='r-4dqfpi8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-871024869',owner_user_name='tempest-VolumesAssistedSnapshotsTest-871024869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af2dcba2de142a3956137ceeef8ee5a',uuid=426b9987-09a0-4c2a-8a51-7cc528b1b5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converting VIF {"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG os_vif [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a58dcc1f-4011-5fcf-b1d0-04f6120aed5a', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc24501-f3, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc24501-f3, col_values=(('qos', UUID('2a590003-cf7c-454f-98c4-cdda0a46d9e2')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc24501-f3, col_values=(('external_ids', {'iface-id': 'ecc24501-f3af-41e1-a92d-a3b6a7cd5b91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:be:83', 'vm-uuid': '426b9987-09a0-4c2a-8a51-7cc528b1b5e3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:27 user nova-compute[75373]: INFO os_vif [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3')
Nov 29 07:21:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] No VIF found with MAC fa:16:3e:80:be:83, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] No waiting events found dispatching network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:28 user nova-compute[75373]: WARNING nova.compute.manager [req-69cf4662-9946-4b58-b397-f5f3ea6fd55e req-28804abf-e1f3-4766-9dba-1aec18d9ffc4 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received unexpected event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 for instance with vm_state active and task_state None.
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Successfully created port: 15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:21:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Instance spawned successfully.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Instance spawned successfully.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Successfully updated port: 15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquired lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Instance spawned successfully.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-changed-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Refreshing instance network info cache due to event network-changed-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Acquiring lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Acquired lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Refreshing network info cache for port ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-changed-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Refreshing instance network info cache due to event network-changed-15b162bd-f8b4-4819-93b2-ef07afc36e14. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] Acquiring lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:29 user sudo[86287]: pam_unix(sudo:session): session closed for user root
Nov 29 07:21:29 user nova-compute[75373]: INFO oslo.privsep.daemon [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Spawned new privsep daemon via rootwrap
Nov 29 07:21:29 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 07:21:29 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 07:21:29 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 07:21:29 user nova-compute[75373]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86370
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Took 15.60 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Took 12.94 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b70583-ac44-4e10-a238-f000928f0782]: (2,) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Took 14.31 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Took 16.13 seconds to build instance.
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Took 17.71 seconds to build instance.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a61ca74-c834-4215-94d6-2883d9703c0b tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.412s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2842d2dc-199b-497b-9c24-22ca36989d1a tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.559s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:29 user nova-compute[75373]: INFO nova.compute.manager [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Took 17.78 seconds to build instance.
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[087f13f5-352e-4a7c-a1dc-c3bd4eda2bdd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: WARNING os_brick.initiator.connectors.nvmeof [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-01411e70-9bf3-4e2a-8fc8-457552ef089e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.641s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.048s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c822b-af71-4491-af53-d434a753997d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62243c-4d21-46d2-ad6c-df7254936427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a7b13-0c52-4912-9dfc-7fd4b6cc8989]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:21:29 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:21:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe8fa4-045b-4396-b03f-c35617568d35]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG os_brick.utils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== get_connector_properties: return (2161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:21:29 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating existing volume attachment record: 1d3c9352-1a37-4676-8702-c1d0050b38c8 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating instance_info_cache with network_info: [{"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Releasing lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance network_info: |[{"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] Acquired lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Refreshing network info cache for port 15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updated VIF entry in instance network info cache for port ecc24501-f3af-41e1-a92d-a3b6a7cd5b91. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updating instance_info_cache with network_info: [{"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Releasing lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] No waiting events found dispatching network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:30 user nova-compute[75373]: WARNING nova.compute.manager [req-6ddbcad0-6569-421b-bb99-2a3699eb66da req-fc25eb76-1339-4698-a0f1-9e128569c491 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received unexpected event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 for instance with vm_state building and task_state spawning.
Nov 29 07:21:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.network.neutron [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updated VIF entry in instance network info cache for port 15b162bd-f8b4-4819-93b2-ef07afc36e14. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.network.neutron [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating instance_info_cache with network_info: [{"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-777a91fc-c319-4cbb-a5ca-d97ce4db66a2 req-2b3edba9-da8d-48d0-8019-b42859149b5b service nova] Releasing lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:31 user nova-compute[75373]: WARNING nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state building and task_state spawning.
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:31 user nova-compute[75373]: WARNING nova.compute.manager [req-a7b06b7b-9259-4fc5-9d0b-b1ed16aafbb2 req-f41fd3ce-c99e-439b-a2b6-cf5363c05e53 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state building and task_state spawning.
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] No waiting events found dispatching network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:31 user nova-compute[75373]: WARNING nova.compute.manager [req-07d6e546-c04e-4020-8aa6-ad27c94043c1 req-f695d54a-8a34-4ea4-a6d3-d0b2ba78c10a service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received unexpected event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 for instance with vm_state active and task_state None.
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Instance spawned successfully.
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:32 user nova-compute[75373]: INFO nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Took 8.56 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:32 user nova-compute[75373]: INFO nova.compute.manager [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Took 10.27 seconds to build instance.
Nov 29 07:21:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6d31cad-31fd-4b73-bf19-b04a5102072e tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.542s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid 6040b882-4024-457a-8f26-8ee29cb54cc6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] No waiting events found dispatching network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:33 user nova-compute[75373]: WARNING nova.compute.manager [req-380d52c9-9e1e-4b17-8d06-3407d4b36e3b req-d5e64ce5-1a9a-4222-b263-3008431be8d9 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received unexpected event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 for instance with vm_state active and task_state None.
Nov 29 07:21:33 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating instance_info_cache with network_info: [{"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-6040b882-4024-457a-8f26-8ee29cb54cc6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:21:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.378s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:21:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Creating image(s)
Nov 29 07:21:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Ensure instance console log exists: /opt/stack/data/nova/instances/ac6981be-a618-43d9-9625-c5d1f4bf44af/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Start _get_guest_xml network_info=[{"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac6981be-a618-43d9-9625-c5d1f4bf44af', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'serial': 'e6660b83-f4e1-4cef-9d0c-bba9d56e4748'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '1d3c9352-1a37-4676-8702-c1d0050b38c8', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:21:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:21:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.589797973632812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connector [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Factory for ISCSI on None {{(pid=75373) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:21:41 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:21:41 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:21:41 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe77be-0016-4a13-ae4c-e6a4996f66b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:21:41 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da85ce4-5cea-4b0b-9e0a-d7de65e376ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748] added
Nov 29 07:21:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124707b-0375-461f-b4ab-ebe3615a4272]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[861e63d1-b2cb-4363-b889-6e2648f3258e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHViLgZh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHViLgZh" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b246d41-889d-4532-8114-615ab739261f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHViLgZh'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee385b2e-1164-47c6-b7f1-b7cb87631f64]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[084b4697-f0bc-42f1-bf47-7e9697230a5a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:21:41 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:21:41 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:21:41 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:21:41 user nova-compute[75373]: 
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59a5f8-03f3-4dfb-8607-3685953c127a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260]
Nov 29 07:21:41 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260] successful.
Nov 29 07:21:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4484a226-e2fd-4e82-9e81-7958adb5a8b4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd81f32-709a-4c4e-89f0-e9ac806188ce]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:21:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:21:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[600053c8-0a5b-46a7-aceb-7fa4c071694e]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:21:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6040b882-4024-457a-8f26-8ee29cb54cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a0bb9854-023a-4f26-98e5-5e8e9209c696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ac6981be-a618-43d9-9625-c5d1f4bf44af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.037s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26662316334393661', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662316334393661', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731604959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1731604959',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj5lOuo2NgeQuJc1EeqhFrPQTlo3rztBiBFN5Ls5P7xd9gRbs8HW82uuSUKiTBRWH9JkcRm+sul7gaTvLCM5tv6bU4sOGiKXl36ceWXwKisnvpxSxEK96TGSNRs3SYvbg==',key_name='tempest-keypair-2040077326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb1f69b2da347f59a3b3db01e2af757',ramdisk_id='',reservation_id='r-jxan4x7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1718834869',owner_user_name='tempest-ServerActionsV293TestJSON-1718834869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4923a7b67f843fd962dcb7df6e26e73',uuid=ac6981be-a618-43d9-9625-c5d1f4bf44af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converting VIF {"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lazy-loading 'pci_devices' on Instance uuid ac6981be-a618-43d9-9625-c5d1f4bf44af {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:21:42 user nova-compute[75373]:   <uuid>ac6981be-a618-43d9-9625-c5d1f4bf44af</uuid>
Nov 29 07:21:42 user nova-compute[75373]:   <name>instance-0000000b</name>
Nov 29 07:21:42 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:21:42 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:21:42 user nova-compute[75373]:   <metadata>
Nov 29 07:21:42 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:21:42 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:21:42 user nova-compute[75373]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1731604959</nova:name>
Nov 29 07:21:42 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:21:41</nova:creationTime>
Nov 29 07:21:42 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:21:42 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:21:42 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:21:42 user nova-compute[75373]:       <nova:owner>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:user uuid="a4923a7b67f843fd962dcb7df6e26e73">tempest-ServerActionsV293TestJSON-1718834869-project-member</nova:user>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:project uuid="5fb1f69b2da347f59a3b3db01e2af757">tempest-ServerActionsV293TestJSON-1718834869</nova:project>
Nov 29 07:21:42 user nova-compute[75373]:       </nova:owner>
Nov 29 07:21:42 user nova-compute[75373]:       <nova:ports>
Nov 29 07:21:42 user nova-compute[75373]:         <nova:port uuid="15b162bd-f8b4-4819-93b2-ef07afc36e14">
Nov 29 07:21:42 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:21:42 user nova-compute[75373]:         </nova:port>
Nov 29 07:21:42 user nova-compute[75373]:       </nova:ports>
Nov 29 07:21:42 user nova-compute[75373]:     </nova:instance>
Nov 29 07:21:42 user nova-compute[75373]:   </metadata>
Nov 29 07:21:42 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:21:42 user nova-compute[75373]:     <system>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="serial">ac6981be-a618-43d9-9625-c5d1f4bf44af</entry>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="uuid">ac6981be-a618-43d9-9625-c5d1f4bf44af</entry>
Nov 29 07:21:42 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:21:42 user nova-compute[75373]:     </system>
Nov 29 07:21:42 user nova-compute[75373]:   </sysinfo>
Nov 29 07:21:42 user nova-compute[75373]:   <os>
Nov 29 07:21:42 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:21:42 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:21:42 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:21:42 user nova-compute[75373]:   </os>
Nov 29 07:21:42 user nova-compute[75373]:   <features>
Nov 29 07:21:42 user nova-compute[75373]:     <acpi/>
Nov 29 07:21:42 user nova-compute[75373]:     <apic/>
Nov 29 07:21:42 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:21:42 user nova-compute[75373]:   </features>
Nov 29 07:21:42 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:21:42 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:21:42 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:21:42 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:21:42 user nova-compute[75373]:   </clock>
Nov 29 07:21:42 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:21:42 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:21:42 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:21:42 user nova-compute[75373]:   </cpu>
Nov 29 07:21:42 user nova-compute[75373]:   <devices>
Nov 29 07:21:42 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:21:42 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:21:42 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:21:42 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:21:42 user nova-compute[75373]:       <serial>e6660b83-f4e1-4cef-9d0c-bba9d56e4748</serial>
Nov 29 07:21:42 user nova-compute[75373]:     </disk>
Nov 29 07:21:42 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:21:42 user nova-compute[75373]:       <mac address="fa:16:3e:65:5b:29"/>
Nov 29 07:21:42 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:42 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:21:42 user nova-compute[75373]:       <target dev="tap15b162bd-f8"/>
Nov 29 07:21:42 user nova-compute[75373]:     </interface>
Nov 29 07:21:42 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:21:42 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/ac6981be-a618-43d9-9625-c5d1f4bf44af/console.log" append="off"/>
Nov 29 07:21:42 user nova-compute[75373]:     </serial>
Nov 29 07:21:42 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:21:42 user nova-compute[75373]:     <video>
Nov 29 07:21:42 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:21:42 user nova-compute[75373]:     </video>
Nov 29 07:21:42 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:21:42 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:21:42 user nova-compute[75373]:     </rng>
Nov 29 07:21:42 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:21:42 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:21:42 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:21:42 user nova-compute[75373]:     </memballoon>
Nov 29 07:21:42 user nova-compute[75373]:   </devices>
Nov 29 07:21:42 user nova-compute[75373]: </domain>
Nov 29 07:21:42 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1731604959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1731604959',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj5lOuo2NgeQuJc1EeqhFrPQTlo3rztBiBFN5Ls5P7xd9gRbs8HW82uuSUKiTBRWH9JkcRm+sul7gaTvLCM5tv6bU4sOGiKXl36ceWXwKisnvpxSxEK96TGSNRs3SYvbg==',key_name='tempest-keypair-2040077326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb1f69b2da347f59a3b3db01e2af757',ramdisk_id='',reservation_id='r-jxan4x7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1718834869',owner_user_name='tempest-ServerActionsV293TestJSON-1718834869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4923a7b67f843fd962dcb7df6e26e73',uuid=ac6981be-a618-43d9-9625-c5d1f4bf44af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converting VIF {"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG os_vif [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08e6dcbe-7d1d-59a3-900c-fa8289d1bb40', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15b162bd-f8, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15b162bd-f8, col_values=(('qos', UUID('bac2fb50-d7af-46e5-938b-77a52cc976d4')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15b162bd-f8, col_values=(('external_ids', {'iface-id': '15b162bd-f8b4-4819-93b2-ef07afc36e14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:5b:29', 'vm-uuid': 'ac6981be-a618-43d9-9625-c5d1f4bf44af'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:21:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:42 user nova-compute[75373]: INFO os_vif [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8')
Nov 29 07:21:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:21:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] No VIF found with MAC fa:16:3e:65:5b:29, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:21:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] No waiting events found dispatching network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:44 user nova-compute[75373]: WARNING nova.compute.manager [req-6f084b3a-91df-433e-a5ad-7072f90be108 req-bf8a69e1-dea1-4195-ad24-46ef04d10489 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received unexpected event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 for instance with vm_state building and task_state spawning.
Nov 29 07:21:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:21:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:21:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:21:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] No waiting events found dispatching network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:21:46 user nova-compute[75373]: WARNING nova.compute.manager [req-aaf63790-073d-42cf-80d2-2ebc36fd45f7 req-43a5b70b-5287-4973-9d94-ce018cf36d73 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received unexpected event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 for instance with vm_state building and task_state spawning.
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:21:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance spawned successfully.
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:21:47 user nova-compute[75373]: INFO nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 29 07:21:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:21:47 user nova-compute[75373]: INFO nova.compute.manager [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Took 20.79 seconds to build instance.
Nov 29 07:21:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f70ff789-aac2-42cc-9362-7770acfec423 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.929s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:21:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:21:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:22:22 user nova-compute[75373]: INFO nova.compute.claims [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Claim successful on node user
Nov 29 07:22:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:22:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.policy [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '315062729f674d828b950a3777d3859b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ab91942a734e9d87ba7ce6c34c0936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:22:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Creating image(s)
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "/opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "/opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "/opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.354s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Successfully created port: 169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk 1073741824" returned: 0 in 0.049s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Cannot resize image /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Ensure instance console log exists: /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Successfully updated port: 169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquired lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-changed-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Refreshing instance network info cache due to event network-changed-169647ce-fc89-404b-aebc-c942b87b4d6e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] Acquiring lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating instance_info_cache with network_info: [{"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Releasing lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Instance network_info: |[{"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] Acquired lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.neutron [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Refreshing network info cache for port 169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Start _get_guest_xml network_info=[{"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:22:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-582720023',display_name='tempest-TestServerVolumeAttachmentScenario-server-582720023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-582720023',id=12,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD+eMQdrQutCZjst7N75EK7TKkcz3bnHmyPAD9Fsp5VkbRa8ICgvz4liP+U5NggN2GC14IMXYVN8Gpt02Msf+irACfvO7bsuz2whk+0WqkyWyQa/MeCVSmH2Z+yDTJkAQ==',key_name='tempest-keypair-1049790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49ab91942a734e9d87ba7ce6c34c0936',ramdisk_id='',reservation_id='r-q4bmc77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1945326043',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1945326043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315062729f674d828b950a3777d3859b',uuid=adaf3c5c-6d17-44db-a652-1fafcc3aeefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converting VIF {"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'pci_devices' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:22:25 user nova-compute[75373]:   <uuid>adaf3c5c-6d17-44db-a652-1fafcc3aeefc</uuid>
Nov 29 07:22:25 user nova-compute[75373]:   <name>instance-0000000c</name>
Nov 29 07:22:25 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:22:25 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:22:25 user nova-compute[75373]:   <metadata>
Nov 29 07:22:25 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:22:25 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-582720023</nova:name>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:22:24</nova:creationTime>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:22:25 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:22:25 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:owner>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:user uuid="315062729f674d828b950a3777d3859b">tempest-TestServerVolumeAttachmentScenario-1945326043-project-member</nova:user>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:project uuid="49ab91942a734e9d87ba7ce6c34c0936">tempest-TestServerVolumeAttachmentScenario-1945326043</nova:project>
Nov 29 07:22:25 user nova-compute[75373]:       </nova:owner>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:22:25 user nova-compute[75373]:       <nova:ports>
Nov 29 07:22:25 user nova-compute[75373]:         <nova:port uuid="169647ce-fc89-404b-aebc-c942b87b4d6e">
Nov 29 07:22:25 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:22:25 user nova-compute[75373]:         </nova:port>
Nov 29 07:22:25 user nova-compute[75373]:       </nova:ports>
Nov 29 07:22:25 user nova-compute[75373]:     </nova:instance>
Nov 29 07:22:25 user nova-compute[75373]:   </metadata>
Nov 29 07:22:25 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:22:25 user nova-compute[75373]:     <system>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="serial">adaf3c5c-6d17-44db-a652-1fafcc3aeefc</entry>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="uuid">adaf3c5c-6d17-44db-a652-1fafcc3aeefc</entry>
Nov 29 07:22:25 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:22:25 user nova-compute[75373]:     </system>
Nov 29 07:22:25 user nova-compute[75373]:   </sysinfo>
Nov 29 07:22:25 user nova-compute[75373]:   <os>
Nov 29 07:22:25 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:22:25 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:22:25 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:22:25 user nova-compute[75373]:   </os>
Nov 29 07:22:25 user nova-compute[75373]:   <features>
Nov 29 07:22:25 user nova-compute[75373]:     <acpi/>
Nov 29 07:22:25 user nova-compute[75373]:     <apic/>
Nov 29 07:22:25 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:22:25 user nova-compute[75373]:   </features>
Nov 29 07:22:25 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:22:25 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:22:25 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:22:25 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:22:25 user nova-compute[75373]:   </clock>
Nov 29 07:22:25 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:22:25 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:22:25 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:22:25 user nova-compute[75373]:   </cpu>
Nov 29 07:22:25 user nova-compute[75373]:   <devices>
Nov 29 07:22:25 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:22:25 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:22:25 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk"/>
Nov 29 07:22:25 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:22:25 user nova-compute[75373]:     </disk>
Nov 29 07:22:25 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:22:25 user nova-compute[75373]:       <mac address="fa:16:3e:2b:c0:0d"/>
Nov 29 07:22:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:25 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:22:25 user nova-compute[75373]:       <target dev="tap169647ce-fc"/>
Nov 29 07:22:25 user nova-compute[75373]:     </interface>
Nov 29 07:22:25 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:22:25 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/console.log" append="off"/>
Nov 29 07:22:25 user nova-compute[75373]:     </serial>
Nov 29 07:22:25 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:22:25 user nova-compute[75373]:     <video>
Nov 29 07:22:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:25 user nova-compute[75373]:     </video>
Nov 29 07:22:25 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:22:25 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:22:25 user nova-compute[75373]:     </rng>
Nov 29 07:22:25 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:22:25 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:22:25 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:22:25 user nova-compute[75373]:     </memballoon>
Nov 29 07:22:25 user nova-compute[75373]:   </devices>
Nov 29 07:22:25 user nova-compute[75373]: </domain>
Nov 29 07:22:25 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-582720023',display_name='tempest-TestServerVolumeAttachmentScenario-server-582720023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-582720023',id=12,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD+eMQdrQutCZjst7N75EK7TKkcz3bnHmyPAD9Fsp5VkbRa8ICgvz4liP+U5NggN2GC14IMXYVN8Gpt02Msf+irACfvO7bsuz2whk+0WqkyWyQa/MeCVSmH2Z+yDTJkAQ==',key_name='tempest-keypair-1049790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49ab91942a734e9d87ba7ce6c34c0936',ramdisk_id='',reservation_id='r-q4bmc77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1945326043',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1945326043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315062729f674d828b950a3777d3859b',uuid=adaf3c5c-6d17-44db-a652-1fafcc3aeefc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converting VIF {"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG os_vif [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11e57a30-8383-5c49-9f1d-472f0ffadd4e', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap169647ce-fc, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap169647ce-fc, col_values=(('qos', UUID('f242244b-480f-4c36-9afc-35264f4f2ab8')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap169647ce-fc, col_values=(('external_ids', {'iface-id': '169647ce-fc89-404b-aebc-c942b87b4d6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:c0:0d', 'vm-uuid': 'adaf3c5c-6d17-44db-a652-1fafcc3aeefc'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: INFO os_vif [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc')
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No VIF found with MAC fa:16:3e:2b:c0:0d, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updated VIF entry in instance network info cache for port 169647ce-fc89-404b-aebc-c942b87b4d6e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating instance_info_cache with network_info: [{"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-992794be-ce4a-413f-88df-c31e2af9de50 req-87516d96-bf41-4d70-a3e7-6c8e3bae68f4 service nova] Releasing lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] No waiting events found dispatching network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:26 user nova-compute[75373]: WARNING nova.compute.manager [req-f4baa048-90ac-4d73-93db-9096673bd5e9 req-7e0eab9a-ca45-4622-b892-10ff749da2ba service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received unexpected event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e for instance with vm_state building and task_state spawning.
Nov 29 07:22:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:22:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Instance spawned successfully.
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:28 user nova-compute[75373]: INFO nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] No waiting events found dispatching network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:28 user nova-compute[75373]: WARNING nova.compute.manager [req-57eb82bc-9633-40e7-a2bc-929881bc8b88 req-e3bdc5de-6eb3-4298-9b13-6425c1f965e6 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received unexpected event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e for instance with vm_state building and task_state spawning.
Nov 29 07:22:28 user nova-compute[75373]: INFO nova.compute.manager [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Took 6.28 seconds to build instance.
Nov 29 07:22:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9676ab87-c8bf-400a-9256-c6ebe8deed58 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.379s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:22:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:32 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:22:33 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:22:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:22:36 user nova-compute[75373]: INFO nova.compute.claims [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Claim successful on node user
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lazy-loading 'flavor' on Instance uuid 6040b882-4024-457a-8f26-8ee29cb54cc6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.165s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:22:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.policy [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bc76bca5efd4f1aaf1250f9d63d1859', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4071c6738f4509a906b090b5ffdb84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: INFO nova.compute.manager [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Attaching volume f88d1b29-eee4-4380-ba55-ebe9ebafafef to /dev/vdb
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:22:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Creating image(s)
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "/opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "/opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.utils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4205f1-26a0-4173-bed2-37bda4ab8b34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4791478-7f86-4f1d-8a72-74088ab31238]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[08675d38-7b17-4d30-b686-d12bc75619fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13c090-864a-45f3-8a82-433dda57031c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:22:37 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8952d0c7-9f00-4c30-89c1-638a9945973c]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG os_brick.utils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating existing volume attachment record: eca6a369-c67b-428e-8ade-f3c1e1199c78 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.241s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: INFO nova.compute.manager [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Rescuing
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.214s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk 1073741824" returned: 0 in 0.055s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Successfully created port: 63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Cannot resize image /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Ensure instance console log exists: /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing instance network info cache due to event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:38 user nova-compute[75373]: WARNING nova.compute.manager [req-a28cbf8a-ac5b-4f01-bb01-95dcd50db107 req-2b4eb953-042e-453d-9480-9df6d0f7cb02 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state rescuing.
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance destroyed successfully.
Nov 29 07:22:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Attempting rescue
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:22:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Creating image(s)
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Successfully updated port: 63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquired lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated VIF entry in instance network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-98b0d570-18e7-4217-adcf-eb85c6a6449e req-0064bccd-01ad-470c-ae13-ebbedf9cd824 service nova] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue" returned: 0 in 0.059s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'migration_context' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.base [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<6aff3409-81c6-4c41-9a03-8f4abfb318c9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start _get_guest_xml network_info=[{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:76:bb:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.base [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<6aff3409-81c6-4c41-9a03-8f4abfb318c9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'numa_topology' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.base [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<6aff3409-81c6-4c41-9a03-8f4abfb318c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:22:39 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:39 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.base [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<6aff3409-81c6-4c41-9a03-8f4abfb318c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622522295',display_name='tempest-ServerRescueNegativeTestJSON-server-622522295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622522295',id=5,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-o5yu09jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:04Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=6aff3409-81c6-4c41-9a03-8f4abfb318c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:76:bb:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:76:bb:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Updating instance_info_cache with network_info: [{"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.base [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<6aff3409-81c6-4c41-9a03-8f4abfb318c9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:22:39 user nova-compute[75373]:   <uuid>6aff3409-81c6-4c41-9a03-8f4abfb318c9</uuid>
Nov 29 07:22:39 user nova-compute[75373]:   <name>instance-00000005</name>
Nov 29 07:22:39 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:22:39 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:22:39 user nova-compute[75373]:   <metadata>
Nov 29 07:22:39 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:22:39 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-622522295</nova:name>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:22:39</nova:creationTime>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:22:39 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:owner>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:owner>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:ports>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:port uuid="1f6722af-05ac-4430-92df-0f566d4c9ef4">
Nov 29 07:22:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:22:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:ports>
Nov 29 07:22:39 user nova-compute[75373]:     </nova:instance>
Nov 29 07:22:39 user nova-compute[75373]:   </metadata>
Nov 29 07:22:39 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:22:39 user nova-compute[75373]:     <system>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="serial">6aff3409-81c6-4c41-9a03-8f4abfb318c9</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="uuid">6aff3409-81c6-4c41-9a03-8f4abfb318c9</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:22:39 user nova-compute[75373]:     </system>
Nov 29 07:22:39 user nova-compute[75373]:   </sysinfo>
Nov 29 07:22:39 user nova-compute[75373]:   <os>
Nov 29 07:22:39 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:22:39 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:22:39 user nova-compute[75373]:   </os>
Nov 29 07:22:39 user nova-compute[75373]:   <features>
Nov 29 07:22:39 user nova-compute[75373]:     <acpi/>
Nov 29 07:22:39 user nova-compute[75373]:     <apic/>
Nov 29 07:22:39 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:22:39 user nova-compute[75373]:   </features>
Nov 29 07:22:39 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:22:39 user nova-compute[75373]:   </clock>
Nov 29 07:22:39 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:22:39 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:22:39 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:22:39 user nova-compute[75373]:   </cpu>
Nov 29 07:22:39 user nova-compute[75373]:   <devices>
Nov 29 07:22:39 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:22:39 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:22:39 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue"/>
Nov 29 07:22:39 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:     </disk>
Nov 29 07:22:39 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:22:39 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:22:39 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk"/>
Nov 29 07:22:39 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:     </disk>
Nov 29 07:22:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:22:39 user nova-compute[75373]:       <mac address="fa:16:3e:76:bb:fa"/>
Nov 29 07:22:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:22:39 user nova-compute[75373]:       <target dev="tap1f6722af-05"/>
Nov 29 07:22:39 user nova-compute[75373]:     </interface>
Nov 29 07:22:39 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:22:39 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/console.log" append="off"/>
Nov 29 07:22:39 user nova-compute[75373]:     </serial>
Nov 29 07:22:39 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:22:39 user nova-compute[75373]:     <video>
Nov 29 07:22:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:     </video>
Nov 29 07:22:39 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:22:39 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:22:39 user nova-compute[75373]:     </rng>
Nov 29 07:22:39 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:22:39 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:22:39 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:22:39 user nova-compute[75373]:     </memballoon>
Nov 29 07:22:39 user nova-compute[75373]:   </devices>
Nov 29 07:22:39 user nova-compute[75373]: </domain>
Nov 29 07:22:39 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Releasing lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Instance network_info: |[{"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Start _get_guest_xml network_info=[{"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:22:39 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:39 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance destroyed successfully.
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-666885323',display_name='tempest-ServersNegativeTestJSON-server-666885323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-666885323',id=13,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-x58tklp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:22:37Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lazy-loading 'pci_devices' on Instance uuid ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:22:39 user nova-compute[75373]:   <uuid>ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281</uuid>
Nov 29 07:22:39 user nova-compute[75373]:   <name>instance-0000000d</name>
Nov 29 07:22:39 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:22:39 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:22:39 user nova-compute[75373]:   <metadata>
Nov 29 07:22:39 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:22:39 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:name>tempest-ServersNegativeTestJSON-server-666885323</nova:name>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:22:39</nova:creationTime>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:22:39 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:owner>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:user uuid="1bc76bca5efd4f1aaf1250f9d63d1859">tempest-ServersNegativeTestJSON-1656759200-project-member</nova:user>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:project uuid="3c4071c6738f4509a906b090b5ffdb84">tempest-ServersNegativeTestJSON-1656759200</nova:project>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:owner>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:22:39 user nova-compute[75373]:       <nova:ports>
Nov 29 07:22:39 user nova-compute[75373]:         <nova:port uuid="63b1b1a5-4d8a-4fd9-8a19-1bde7852977d">
Nov 29 07:22:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 07:22:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:22:39 user nova-compute[75373]:       </nova:ports>
Nov 29 07:22:39 user nova-compute[75373]:     </nova:instance>
Nov 29 07:22:39 user nova-compute[75373]:   </metadata>
Nov 29 07:22:39 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:22:39 user nova-compute[75373]:     <system>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="serial">ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="uuid">ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281</entry>
Nov 29 07:22:39 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:22:39 user nova-compute[75373]:     </system>
Nov 29 07:22:39 user nova-compute[75373]:   </sysinfo>
Nov 29 07:22:39 user nova-compute[75373]:   <os>
Nov 29 07:22:39 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:22:39 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:22:39 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:22:39 user nova-compute[75373]:   </os>
Nov 29 07:22:39 user nova-compute[75373]:   <features>
Nov 29 07:22:39 user nova-compute[75373]:     <acpi/>
Nov 29 07:22:39 user nova-compute[75373]:     <apic/>
Nov 29 07:22:39 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:22:39 user nova-compute[75373]:   </features>
Nov 29 07:22:39 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:22:39 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:22:39 user nova-compute[75373]:   </clock>
Nov 29 07:22:39 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:22:39 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:22:39 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:22:39 user nova-compute[75373]:   </cpu>
Nov 29 07:22:39 user nova-compute[75373]:   <devices>
Nov 29 07:22:39 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:22:39 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:22:39 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk"/>
Nov 29 07:22:39 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:     </disk>
Nov 29 07:22:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:22:39 user nova-compute[75373]:       <mac address="fa:16:3e:14:7b:36"/>
Nov 29 07:22:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:22:39 user nova-compute[75373]:       <target dev="tap63b1b1a5-4d"/>
Nov 29 07:22:39 user nova-compute[75373]:     </interface>
Nov 29 07:22:39 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:22:39 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/console.log" append="off"/>
Nov 29 07:22:39 user nova-compute[75373]:     </serial>
Nov 29 07:22:39 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:22:39 user nova-compute[75373]:     <video>
Nov 29 07:22:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:22:39 user nova-compute[75373]:     </video>
Nov 29 07:22:39 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:22:39 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:22:39 user nova-compute[75373]:     </rng>
Nov 29 07:22:39 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:22:39 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:22:39 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:22:39 user nova-compute[75373]:     </memballoon>
Nov 29 07:22:39 user nova-compute[75373]:   </devices>
Nov 29 07:22:39 user nova-compute[75373]: </domain>
Nov 29 07:22:39 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-666885323',display_name='tempest-ServersNegativeTestJSON-server-666885323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-666885323',id=13,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-x58tklp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:22:37Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG os_vif [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6200e75c-99af-5679-af43-bdfb9d9b1701', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:76:bb:fa, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63b1b1a5-4d, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63b1b1a5-4d, col_values=(('qos', UUID('136213ec-30cb-422a-bfa8-b1aedbafd97e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63b1b1a5-4d, col_values=(('external_ids', {'iface-id': '63b1b1a5-4d8a-4fd9-8a19-1bde7852977d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7b:36', 'vm-uuid': 'ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:39 user nova-compute[75373]: INFO os_vif [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d')
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] No VIF found with MAC fa:16:3e:14:7b:36, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-changed-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Refreshing instance network info cache due to event network-changed-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Acquiring lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Acquired lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.network.neutron [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Refreshing network info cache for port 63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.network.neutron [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Updated VIF entry in instance network info cache for port 63b1b1a5-4d8a-4fd9-8a19-1bde7852977d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.network.neutron [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Updating instance_info_cache with network_info: [{"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Releasing lock "refresh_cache-ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:40 user nova-compute[75373]: WARNING nova.compute.manager [req-de714171-daf8-49c4-be35-3d83510e23c5 req-ef2d4a6c-92ef-43bf-b936-f4ef7425f561 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state rescuing.
Nov 29 07:22:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] No waiting events found dispatching network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:42 user nova-compute[75373]: WARNING nova.compute.manager [req-4608d6b8-0ccb-4167-beec-b309bbc359c2 req-c3beb4df-4998-472d-8789-cbe58dfdc6f0 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received unexpected event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d for instance with vm_state building and task_state spawning.
Nov 29 07:22:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:42 user nova-compute[75373]: WARNING nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state rescuing.
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:42 user nova-compute[75373]: WARNING nova.compute.manager [req-f4d86178-9c69-4003-8c17-93159212234b req-733c125e-735c-4a62-b2ff-cabf1d82dc47 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state active and task_state rescuing.
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] No waiting events found dispatching network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:44 user nova-compute[75373]: WARNING nova.compute.manager [req-cf2d69c8-6e9a-4847-8021-d234be3a860e req-092c9fa2-9471-4f36-8ada-96016560edb5 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received unexpected event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d for instance with vm_state building and task_state spawning.
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a85e2443-c281-410a-bb3f-43430043d5ac tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:22:44 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:44 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=6863MB free_disk=25.431644439697266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Instance spawned successfully.
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:22:44 user nova-compute[75373]: INFO nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlMkezfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:22:44 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:22:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:22:44 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:22:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:22:44 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6040b882-4024-457a-8f26-8ee29cb54cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:44 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a0bb9854-023a-4f26-98e5-5e8e9209c696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ac6981be-a618-43d9-9625-c5d1f4bf44af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a22bf-9f71-46e0-a697-6202e21dcc4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:22:45 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: INFO nova.compute.manager [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Took 8.84 seconds to build instance.
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236fdc7-8e6c-45c9-a365-b8d1118b6e64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef] added
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d34f9335-665b-412d-b956-6e80afa372dd tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.941s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3357c1be-a8aa-4047-9a5e-ddaf99b73970]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18b6177-677f-4b02-8634-bf41cec47b89]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlMkezfc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlMkezfc" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0913f4-6fd2-4d87-9120-404b0ff966e8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlMkezfc'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccdbc98-349c-4b7e-b429-0c58d84c2ffd]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe04107b-6ad2-44c5-9295-f4ce26b7a4f3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[66910a53-863b-4920-956c-3ce6eb83de80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260]
Nov 29 07:22:45 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260] successful.
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[990ac1ae-7366-4824-bd5c-85097d2fa371]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ba9666-0a50-4ccc-bb61-0bf8a2d878dc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:45 user nova-compute[75373]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:45 user nova-compute[75373]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)
Nov 29 07:22:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[005df7de-04d3-4527-833c-38b0c6e4962c]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlMkezfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:22:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26362663131613431', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663131613431', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lazy-loading 'flavor' on Instance uuid 6040b882-4024-457a-8f26-8ee29cb54cc6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:22:46 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:22:46 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:22:46 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:22:46 user nova-compute[75373]:   <serial>f88d1b29-eee4-4380-ba55-ebe9ebafafef</serial>
Nov 29 07:22:46 user nova-compute[75373]: </disk>
Nov 29 07:22:46 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:22:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] No VIF found with MAC fa:16:3e:a3:2e:6c, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2828378e-9d9d-48cf-9840-af86ff8e6b3c tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.163s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:47 user nova-compute[75373]: INFO nova.compute.manager [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Terminating instance
Nov 29 07:22:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:22:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-unplugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] No waiting events found dispatching network-vif-unplugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-7aed08bd-d28d-49ac-b18a-5c76c5bb6a92 req-43d9fd9e-a8b3-493b-974c-b61b795cbf09 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-unplugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:22:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Instance destroyed successfully.
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.objects.instance [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lazy-loading 'resources' on Instance uuid 6040b882-4024-457a-8f26-8ee29cb54cc6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1067214700',display_name='tempest-DeleteServersTestJSON-server-1067214700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1067214700',id=1,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c4e46125e574accb1c6590e0b3c59c3',ramdisk_id='',reservation_id='r-m537ezt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1785512475',owner_user_name='tempest-DeleteServersTestJSON-1785512475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:05Z,user_data=None,user_id='aad1e98486b240358cbda80031ef96df',uuid=6040b882-4024-457a-8f26-8ee29cb54cc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converting VIF {"id": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "address": "fa:16:3e:a3:2e:6c", "network": {"id": "83b25e2d-a96d-4869-ad9c-97686bb4f759", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-83679986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c4e46125e574accb1c6590e0b3c59c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeff47ecd-7f", "ovs_interfaceid": "eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_vif [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeff47ecd-7f, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6c31aa4-f38c-461d-b41a-3821dbde6fa9) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:48 user nova-compute[75373]: INFO os_vif [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59,network=Network(83b25e2d-a96d-4869-ad9c-97686bb4f759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeff47ecd-7f')
Nov 29 07:22:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlMkezfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:22:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478cfd1-db6d-4408-9031-5c2a16f842a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:22:48 user nova-compute[75373]: No targets found.
Nov 29 07:22:48 user nova-compute[75373]: iSNS:
Nov 29 07:22:48 user nova-compute[75373]: No targets found.
Nov 29 07:22:48 user nova-compute[75373]: STATIC:
Nov 29 07:22:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748
Nov 29 07:22:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:22:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:22:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef
Nov 29 07:22:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:22:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:22:48 user nova-compute[75373]: FIRMWARE:
Nov 29 07:22:48 user nova-compute[75373]: No targets found.
Nov 29 07:22:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:22:48 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:22:48 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1fe71-5f5a-4f5f-97af-676c941496a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6640db-3abc-4274-9ca3-f62126991da0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:48 user nova-compute[75373]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)
Nov 29 07:22:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:22:48 user nova-compute[75373]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef (non-flash)
Nov 29 07:22:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b00192a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[960a699e-945c-49be-bee0-86c65172fe97]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e46123-a89c-4248-aaff-755c5a8d5411]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd19167-722b-45a0-ad9e-d0af3319e9ec]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed7ac19-8de8-4664-80d8-a50ff68094d2]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d07704-0550-4046-b842-3966da649b37]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf9e9a-6934-4597-b7f7-efcfdda83718]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260]
Nov 29 07:22:49 user nova-compute[75373]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef, portal: 172.16.0.220,3260] successful.
Nov 29 07:22:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88d1b29-eee4-4380-ba55-ebe9ebafafef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5ac04-3870-43c4-a97f-46222087b5f0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] <== disconnect_volume: return (286ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Deleting instance files /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6_del
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Deletion of /opt/stack/data/nova/instances/6040b882-4024-457a-8f26-8ee29cb54cc6_del complete
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75373) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.virt.libvirt.host [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] UEFI support detected
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.compute.manager [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 07:22:49 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Took 0.78 seconds to deallocate network for instance.
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-0f572729-ad64-494a-8df6-9edcfca375a0 req-af28fb7f-eae5-418e-ac72-cb8f54b53d63 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-deleted-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:49 user nova-compute[75373]: INFO nova.compute.manager [req-0f572729-ad64-494a-8df6-9edcfca375a0 req-af28fb7f-eae5-418e-ac72-cb8f54b53d63 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Neutron deleted interface eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59; detaching it from the instance and deleting it from the info cache
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.network.neutron [req-0f572729-ad64-494a-8df6-9edcfca375a0 req-af28fb7f-eae5-418e-ac72-cb8f54b53d63 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-0f572729-ad64-494a-8df6-9edcfca375a0 req-af28fb7f-eae5-418e-ac72-cb8f54b53d63 service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Detach interface failed, port_id=eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59, reason: Instance 6040b882-4024-457a-8f26-8ee29cb54cc6 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] Acquiring lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] No waiting events found dispatching network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:22:50 user nova-compute[75373]: WARNING nova.compute.manager [req-25da1d93-b358-4ff9-870a-e9f6599af6d0 req-ba94f626-fc49-4ed6-beab-4f9950eff48a service nova] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Received unexpected event network-vif-plugged-eff47ecd-7f18-4dee-b0c1-b1a6b47e5a59 for instance with vm_state active and task_state deleting.
Nov 29 07:22:50 user nova-compute[75373]: INFO nova.compute.manager [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] [instance: 6040b882-4024-457a-8f26-8ee29cb54cc6] Took 0.86 seconds to detach 1 volumes for instance.
Nov 29 07:22:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:51 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:22:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:22:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:51 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Deleted allocations for instance 6040b882-4024-457a-8f26-8ee29cb54cc6
Nov 29 07:22:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5e261d09-e02d-48ca-8e97-61d8d5f9f764 tempest-DeleteServersTestJSON-1785512475 tempest-DeleteServersTestJSON-1785512475-project-member] Lock "6040b882-4024-457a-8f26-8ee29cb54cc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.639s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-changed-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Refreshing instance network info cache due to event network-changed-47aff5a9-b99d-4805-afc7-fea4aa29f673. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] Acquiring lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] Acquired lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Refreshing network info cache for port 47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updated VIF entry in instance network info cache for port 47aff5a9-b99d-4805-afc7-fea4aa29f673. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating instance_info_cache with network_info: [{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:22:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8f19d844-acce-40e5-bee7-e7345ee5f2d1 req-85e384f1-3153-4ee0-9aa7-45782035ca85 service nova] Releasing lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:22:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:22:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:56 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'flavor' on Instance uuid b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:22:57 user nova-compute[75373]: INFO nova.compute.manager [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Attaching volume 14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 to /dev/vdb
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.utils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae6b36-6ec6-4ebe-bdad-a82dfeee80ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb9b0cf-5b2f-4cbc-8c52-ec0816aa1ca1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0d4d1-033f-4d2d-9546-79230a3a5fce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7695bcee-8159-498c-ab69-dafea691b29f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:22:57 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:22:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[135fd049-aea8-49ed-bfcb-b3575537c729]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG os_brick.utils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:22:57 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating existing volume attachment record: 8bd57aa2-1dcc-4256-af38-fa0e4aa1bb6f {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:22:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-changed-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Refreshing instance network info cache due to event network-changed-7f395be8-0836-4f70-8d99-8c9a1ea95d07. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] Acquiring lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] Acquired lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Refreshing network info cache for port 7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updated VIF entry in instance network info cache for port 7f395be8-0836-4f70-8d99-8c9a1ea95d07. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updating instance_info_cache with network_info: [{"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8cc31d3d-a351-48de-b40a-bd3230102e59 req-4231a9ec-df45-4c2e-986a-4eaf5d3cb079 service nova] Releasing lock "refresh_cache-a0bb9854-023a-4f26-98e5-5e8e9209c696" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'pci_requests' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.objects.base [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Object Instance<d5f12e85-8ea5-4a78-85c3-c5bf2ad62951> lazy-loaded attributes: flavor,pci_requests {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:23:02 user nova-compute[75373]: DEBUG nova.policy [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b8794171dae42239ca57e9a36182ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fdf48c94fd4557ad3f5f3a59c8726b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Successfully created port: c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-changed-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Refreshing instance network info cache due to event network-changed-267199ca-0c64-4c5e-855c-538cb80aeba8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] Acquiring lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] Acquired lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Refreshing network info cache for port 267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-changed-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing instance network info cache due to event network-changed-7370770a-61cd-4282-aff1-a6c5fa9bb065. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing network info cache for port 7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lazy-loading 'flavor' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:04 user nova-compute[75373]: INFO nova.compute.manager [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attaching volume 7f30cec8-2d2b-4778-8b74-a940c010584b to /dev/vdb
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.utils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Successfully updated port: c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c15f008-e961-400f-a837-bcaab85026fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updated VIF entry in instance network info cache for port 267199ca-0c64-4c5e-855c-538cb80aeba8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updating instance_info_cache with network_info: [{"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d4f9d06-2e6f-4aaf-a142-16529d9cd01d req-55bbe735-06c5-425d-ab82-399e75392ae5 service nova] Releasing lock "refresh_cache-9eeeba70-7aba-4471-8bd8-6710fc3f5c17" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e0712f-e4d5-4d67-9983-38b687cc6a10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9709e50-d417-4234-9f37-62e3b229b282]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb736a0-e825-40f6-946b-44aef93e1dcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:04 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31256db-0a41-4254-a3d0-df2061491ddb]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.utils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updating existing volume attachment record: f422d555-17b4-4fdf-87f7-535c39f8b1b9 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lazy-loading 'flavor' on Instance uuid a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updated VIF entry in instance network info cache for port 7370770a-61cd-4282-aff1-a6c5fa9bb065. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b4ee1b4c-6cb5-437d-b88a-e2d2099ae918 req-2929db4c-82be-4fd8-9689-c458c2bb9c75 service nova] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:04 user nova-compute[75373]: INFO nova.compute.manager [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Attaching volume 916b50d3-45ef-494d-92fb-c059c91d73c1 to /dev/sdc
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbMpfPOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:04 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa34628-062c-4f1d-a784-5a89ef92bf54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:04 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[636df333-8c8c-45e3-9285-8420627488ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6] added
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.utils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edcfae9-b92e-4a8d-a14e-be5039c0cb99]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4008077-d873-4f68-8a13-923d52bc9851]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d06882-8e33-46eb-940f-0724cfd2e3fa]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbMpfPOd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3af0b-5299-4e33-a7c2-9593d5a3b8c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbMpfPOd" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4cfdd-1f00-4887-87f6-74dba859a52a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbMpfPOd'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd023f-9fd4-41b2-b59f-d55371cf8461]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3506276-bb08-4632-8c6f-90dbbb909f46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[733b1913-d948-4bcd-b6b8-97829ed804ba]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:04 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c53fbe-31c9-4763-aadf-f45541de16ca]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.utils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updating existing volume attachment record: c04d4d6a-e807-46df-ad05-538c70fd6405 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a33b544-e533-430f-b5b6-8a7a864d5bff]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fcf2af-c9e5-4522-b428-923f2c34eeef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260]
Nov 29 07:23:04 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ca87a4-7786-4984-a224-b6d4a94cefe9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc3bf6-0871-4005-8e00-7e2ae7452897]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ee9e1-77de-49e7-a05f-9c2cdd552414]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbMpfPOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG os_vif [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56ccf634-c4da-5f1a-b102-5eb54212b5cf', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9bbc0d9-9f, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9bbc0d9-9f, col_values=(('qos', UUID('95519573-6e80-469a-a176-12f500962b4e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9bbc0d9-9f, col_values=(('external_ids', {'iface-id': 'c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:e0:74', 'vm-uuid': 'd5f12e85-8ea5-4a78-85c3-c5bf2ad62951'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: INFO os_vif [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f')
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] attach device xml: <interface type="ethernet">
Nov 29 07:23:05 user nova-compute[75373]:   <mac address="fa:16:3e:df:e0:74"/>
Nov 29 07:23:05 user nova-compute[75373]:   <model type="virtio"/>
Nov 29 07:23:05 user nova-compute[75373]:   <mtu size="1442"/>
Nov 29 07:23:05 user nova-compute[75373]:   <target dev="tapc9bbc0d9-9f"/>
Nov 29 07:23:05 user nova-compute[75373]: </interface>
Nov 29 07:23:05 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name hda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No VIF found with MAC fa:16:3e:9a:d0:ac, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:05 user nova-compute[75373]: WARNING nova.compute.manager [req-cdf57e7e-abf4-4922-be64-56136f4d4fb6 req-aa503947-1bf9-4408-bcb1-ac42404f6857 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd for instance with vm_state active and task_state None.
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:23:05 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:23:05</nova:creationTime>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:23:05 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:23:05 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:owner>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:23:05 user nova-compute[75373]:   </nova:owner>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:23:05 user nova-compute[75373]:   <nova:ports>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:23:05 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:23:05 user nova-compute[75373]:     </nova:port>
Nov 29 07:23:05 user nova-compute[75373]:     <nova:port uuid="c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd">
Nov 29 07:23:05 user nova-compute[75373]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Nov 29 07:23:05 user nova-compute[75373]:     </nova:port>
Nov 29 07:23:05 user nova-compute[75373]:   </nova:ports>
Nov 29 07:23:05 user nova-compute[75373]: </nova:instance>
Nov 29 07:23:05 user nova-compute[75373]:  {{(pid=75373) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-changed-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing instance network info cache due to event network-changed-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Refreshing network info cache for port c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-899ad57c-0d71-4eef-8866-110a745f62a7 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.607s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23639663536313165', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639663536313165', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'flavor' on Instance uuid b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:23:06 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:06 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:23:06 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:06 user nova-compute[75373]:   <serial>14d6cda5-213e-487a-a4bb-5fc2bf17e4d6</serial>
Nov 29 07:23:06 user nova-compute[75373]: </disk>
Nov 29 07:23:06 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updated VIF entry in instance network info cache for port c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bfaf7fc3-1854-4a35-ba24-40669a74a0b6 req-bcce5727-8c82-40ab-a65d-30e79411cf59 service nova] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:06 user nova-compute[75373]: INFO nova.compute.manager [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Attaching volume 9a3ebe76-fd87-4cbc-affd-3882590c7a3f to /dev/vdb
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No VIF found with MAC fa:16:3e:17:d8:78, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.utils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386113b-4513-4a24-9c9e-544d6ed7dee0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4688420-9ea6-41bf-9a5b-b2eb3bd37f56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff7867b-c3c9-48fb-8710-4aa9aabc6736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c59b5-0d3a-43b9-bfb0-d2a9ff367d36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:06 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[55de57ef-3598-4e37-a984-b728bc856662]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4557dafe-c95e-45b2-864c-3bafc30d6c0a tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.641s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG os_brick.utils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:06 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating existing volume attachment record: 5c7c5c2a-b8dc-44be-9c6d-8f781257ae44 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:23:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:07 user nova-compute[75373]: WARNING nova.compute.manager [req-bc4ce383-c462-47c0-be18-42d5bef0aea1 req-2f3285db-28c8-4bda-8f81-7932d55a4cae service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd for instance with vm_state active and task_state None.
Nov 29 07:23:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:12 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:12 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:12 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[107cfe7a-6485-4da9-95d2-bc927158ed6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:12 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0211a-4248-45da-9f46-8b29359fc202]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b] added
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c1785-e012-4bae-ac47-25e9d2149351]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c2943-a7b6-46f8-a539-2d8591b8b545]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzbVMQan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzbVMQan" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cdcb6-5574-4a8a-a311-7c615808b9a7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzbVMQan'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b9ead4-b98c-45c6-b111-cfda1c9a5ce2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b714971-4ea4-4199-b02a-1402a733ec15]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[80248c3f-d844-42cf-84e7-43b6fa6e21e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]
Nov 29 07:23:12 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a54a432-5c33-4020-9660-acfe5329b214]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839a741-fd5d-4574-b791-30c1ab500792]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:12 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:12 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d9d6c-fd54-433b-8ce6-9d0e4e6f818c]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-changed-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Refreshing instance network info cache due to event network-changed-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] Acquiring lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] Acquired lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:12 user nova-compute[75373]: DEBUG nova.network.neutron [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Refreshing network info cache for port ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lazy-loading 'flavor' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updated VIF entry in instance network info cache for port ecc24501-f3af-41e1-a92d-a3b6a7cd5b91. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updating instance_info_cache with network_info: [{"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599da911-4d83-48c9-9b55-d2a0216071c7 req-4efd1539-1bfd-4257-b28f-25cc8b0b3680 service nova] Releasing lock "refresh_cache-426b9987-09a0-4c2a-8a51-7cc528b1b5e3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:13 user nova-compute[75373]: INFO nova.compute.manager [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Attaching volume 310d494c-cda3-4bf7-a0e4-9b68c815976b to /dev/vdb
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSoNmAew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:13 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:13 user nova-compute[75373]: INFO nova.compute.manager [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Detaching volume 14d6cda5-213e-487a-a4bb-5fc2bf17e4d6
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.utils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06abf43-17bc-4f08-a3db-66ab6f8e784e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: INFO nova.virt.block_device [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Attempting to driver detach volume 14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 from mountpoint /dev/vdb
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[614946f1-7192-4f0b-ba98-fce076dffb06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Attempting to detach device vdb from instance b791f041-3d5e-4f5f-b354-3651b9238077 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:13 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:13 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:23:13 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:13 user nova-compute[75373]:   <serial>14d6cda5-213e-487a-a4bb-5fc2bf17e4d6</serial>
Nov 29 07:23:13 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:13 user nova-compute[75373]: </disk>
Nov 29 07:23:13 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[242c3810-cc9a-4421-8f08-9d7252c8afe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b19573-6c86-490e-ba65-ee3bf2229c44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully detached device vdb from instance b791f041-3d5e-4f5f-b354-3651b9238077 from the persistent domain config.
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b791f041-3d5e-4f5f-b354-3651b9238077 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:13 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:13 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:23:13 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:13 user nova-compute[75373]:   <serial>14d6cda5-213e-487a-a4bb-5fc2bf17e4d6</serial>
Nov 29 07:23:13 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:13 user nova-compute[75373]: </disk>
Nov 29 07:23:13 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:13 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0426e-a4c0-4d28-8d4d-1caeedd8f3cc]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.utils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updating existing volume attachment record: ce2dc7ce-8f98-403c-80b9-7b8c9e040fc7 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23366653534303564', 'path': '/dev/sdd'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366653534303564', 'path': '/dev/sdd'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.287s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:13 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:13 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lazy-loading 'flavor' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[133e77fc-9d67-4bd7-a8fe-8a1178a5d118]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:13 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:23:13 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:13 user nova-compute[75373]:   <source dev="/dev/sdd"/>
Nov 29 07:23:13 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:13 user nova-compute[75373]:   <serial>7f30cec8-2d2b-4778-8b74-a940c010584b</serial>
Nov 29 07:23:13 user nova-compute[75373]: </disk>
Nov 29 07:23:13 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf43543-abe0-4c1e-abce-f3b5c71f8fba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1] added
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d50090-35cd-4667-8c43-88bba484fb98]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da784c-a303-44c8-843a-3c91c8e77ac0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSoNmAew {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSoNmAew" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e5b2fe-1171-4057-8980-a6ebcefbcbb7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aSoNmAew'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e0c17-b74a-4af4-9657-2e8cf9792f5e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a075ae-d54b-441f-9a80-d412a1caa6a7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c952f62-0aef-453c-b014-454bf1fb78e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260]
Nov 29 07:23:13 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d7fb9-d188-44e0-b8c5-9cf5508718ce]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be16c2-ca67-4c34-a10b-acd96909a701]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:13 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a099145-3a3d-4d1d-b408-340d89bc46a9]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSoNmAew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] No VIF found with MAC fa:16:3e:cf:7e:47, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-731dab55-ad99-45be-891d-56406957fa6d tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.476s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWbioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:14 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] <== connect_volume: return (1640ms) {'type': 'block', 'scsi_wwn': '23334626538653139', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334626538653139', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.217s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:15 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:15 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lazy-loading 'flavor' on Instance uuid a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4997ee-9545-4bbc-9925-48dca37d1a5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:15 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:23:15 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:15 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:23:15 user nova-compute[75373]:   <target dev="sdc" bus="scsi"/>
Nov 29 07:23:15 user nova-compute[75373]:   <serial>916b50d3-45ef-494d-92fb-c059c91d73c1</serial>
Nov 29 07:23:15 user nova-compute[75373]:   <address type="drive" controller="0" unit="2"/>
Nov 29 07:23:15 user nova-compute[75373]: </disk>
Nov 29 07:23:15 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e09a8a-e882-42ef-ad90-a2d30a5d4c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f] added
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[864251a9-f425-4047-ad68-4fb3ade2e371]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfa2f0-f03f-492c-80ae-f0118b576298]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWbioH {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWbioH" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[373930a2-3e73-4d04-bf73-d66a8b5b4742]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFVWbioH'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05581a47-b106-45f7-b030-56921f9872dc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29132f9-5e81-4ab1-a035-a9df47a8e425]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[028fa8ac-6db3-4358-ba2f-78a1a0afad62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260]
Nov 29 07:23:15 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec40ce7-06a6-43fd-94e3-bd54bb32b3be]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ae26b-b484-4c01-98dc-9d59a43060d9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:15 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a404f5-ecd7-452b-8923-1c37fc3e50ed]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWbioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No BDM found with device name sda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] No VIF found with MAC fa:16:3e:aa:14:d0, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fd87df61-84af-4839-98ec-17d491971265 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.078s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[99119593-78bd-4472-b3bd-023003fd69dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ca3f5-0ad8-43da-82e0-7b998d4db064]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b7c11-d8e2-458e-b9a0-222c24a9826b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2006c4a-fa89-4d8c-abed-699bf187f15f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:16 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2452f2-65ef-4ef2-bf48-d7d4bb819f4e]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '26332363561333736', 'path': '/dev/sdf'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332363561333736', 'path': '/dev/sdf'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:16 user nova-compute[75373]: INFO nova.compute.manager [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Detaching volume 916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:23:16 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:16 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:23:16 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:16 user nova-compute[75373]:   <serial>9a3ebe76-fd87-4cbc-affd-3882590c7a3f</serial>
Nov 29 07:23:16 user nova-compute[75373]: </disk>
Nov 29 07:23:16 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:16 user nova-compute[75373]: INFO nova.compute.manager [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Swapping volume 7f30cec8-2d2b-4778-8b74-a940c010584b for ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:16 user nova-compute[75373]: INFO nova.virt.block_device [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Attempting to driver detach volume 916b50d3-45ef-494d-92fb-c059c91d73c1 from mountpoint /dev/sdc
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Attempting to detach device sdc from instance a0bb9854-023a-4f26-98e5-5e8e9209c696 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:16 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:16 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:23:16 user nova-compute[75373]:   <target dev="sdc" bus="scsi"/>
Nov 29 07:23:16 user nova-compute[75373]:   <serial>916b50d3-45ef-494d-92fb-c059c91d73c1</serial>
Nov 29 07:23:16 user nova-compute[75373]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 07:23:16 user nova-compute[75373]: </disk>
Nov 29 07:23:16 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Successfully detached device sdc from instance a0bb9854-023a-4f26-98e5-5e8e9209c696 from the persistent domain config.
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance a0bb9854-023a-4f26-98e5-5e8e9209c696 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:16 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:16 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:23:16 user nova-compute[75373]:   <target dev="sdc" bus="scsi"/>
Nov 29 07:23:16 user nova-compute[75373]:   <serial>916b50d3-45ef-494d-92fb-c059c91d73c1</serial>
Nov 29 07:23:16 user nova-compute[75373]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 07:23:16 user nova-compute[75373]: </disk>
Nov 29 07:23:16 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No BDM found with device name hda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] No VIF found with MAC fa:16:3e:9a:d0:ac, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-332f2cfa-1849-4a35-8064-dd8c1b7c4c0e tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.483s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-changed-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Refreshing instance network info cache due to event network-changed-15b162bd-f8b4-4819-93b2-ef07afc36e14. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] Acquiring lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] Acquired lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Refreshing network info cache for port 15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updated VIF entry in instance network info cache for port 15b162bd-f8b4-4819-93b2-ef07afc36e14. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating instance_info_cache with network_info: [{"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-885f8683-b696-4750-a011-8b7e91144106 req-b91abae6-0ab7-44b3-ae1d-1cd66cd1ab84 service nova] Releasing lock "refresh_cache-ac6981be-a618-43d9-9625-c5d1f4bf44af" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:18 user nova-compute[75373]: INFO nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Rebuilding instance
Nov 29 07:23:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:18 user nova-compute[75373]: INFO nova.compute.manager [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Detaching volume 9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:23:18 user nova-compute[75373]: INFO nova.virt.block_device [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Attempting to driver detach volume 9a3ebe76-fd87-4cbc-affd-3882590c7a3f from mountpoint /dev/vdb
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Attempting to detach device vdb from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:18 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:18 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:23:18 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:18 user nova-compute[75373]:   <serial>9a3ebe76-fd87-4cbc-affd-3882590c7a3f</serial>
Nov 29 07:23:18 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:23:18 user nova-compute[75373]: </disk>
Nov 29 07:23:18 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:18 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully detached device vdb from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the persistent domain config.
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:18 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:18 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:23:18 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:18 user nova-compute[75373]:   <serial>9a3ebe76-fd87-4cbc-affd-3882590c7a3f</serial>
Nov 29 07:23:18 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:23:18 user nova-compute[75373]: </disk>
Nov 29 07:23:18 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-vif-unplugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] No waiting events found dispatching network-vif-unplugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:19 user nova-compute[75373]: WARNING nova.compute.manager [req-783d12eb-5d38-4c3b-ade5-b739f3764ede req-18243fc6-7ccd-4626-b965-06b86e78867c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received unexpected event network-vif-unplugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 for instance with vm_state active and task_state rebuilding.
Nov 29 07:23:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance destroyed successfully.
Nov 29 07:23:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance destroyed successfully.
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2098770352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1731604959',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj5lOuo2NgeQuJc1EeqhFrPQTlo3rztBiBFN5Ls5P7xd9gRbs8HW82uuSUKiTBRWH9JkcRm+sul7gaTvLCM5tv6bU4sOGiKXl36ceWXwKisnvpxSxEK96TGSNRs3SYvbg==',key_name='tempest-keypair-2040077326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5fb1f69b2da347f59a3b3db01e2af757',ramdisk_id='',reservation_id='r-jxan4x7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1718834869',owner_user_name='tempest-ServerActionsV293TestJSON-1718834869-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4923a7b67f843fd962dcb7df6e26e73',uuid=ac6981be-a618-43d9-9625-c5d1f4bf44af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converting VIF {"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_vif [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15b162bd-f8, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bac2fb50-d7af-46e5-938b-77a52cc976d4) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:23:19 user nova-compute[75373]: INFO os_vif [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8')
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:19 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e51e3cd-1ac1-4266-81aa-2c4e1d44bcd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:19 user nova-compute[75373]: No targets found.
Nov 29 07:23:19 user nova-compute[75373]: iSNS:
Nov 29 07:23:19 user nova-compute[75373]: No targets found.
Nov 29 07:23:19 user nova-compute[75373]: STATIC:
Nov 29 07:23:19 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:19 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:19 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:19 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6
Nov 29 07:23:19 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:19 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:19 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:19 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:19 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:19 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748
Nov 29 07:23:19 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:19 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:19 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:19 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:19 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:19 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:19 user nova-compute[75373]: No targets found.
Nov 29 07:23:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:19 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:19 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccc7067-1557-4bb2-bcea-83bbdd51e677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[21851cfd-5506-4c1b-a7c4-2ca3d53b78c8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:19 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b11692050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[40444184-7b51-4ac7-94a2-2f308e88c98a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e1c011-a202-4f19-920c-e27a62875e0c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceba332-53b8-4c9f-9cce-22fc0d8fd3f0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f065818-6477-44b3-938e-5c7a5ce87e63]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d0df3e-459c-4570-b167-ba798dc1bdb8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c07fc-25c3-4bda-94ee-a16d86c49fdc]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260]
Nov 29 07:23:19 user nova-compute[75373]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa595b5-8b72-444c-a807-503e1c3e6f1d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== disconnect_volume: return (337ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Deleting instance files /opt/stack/data/nova/instances/ac6981be-a618-43d9-9625-c5d1f4bf44af_del
Nov 29 07:23:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Deletion of /opt/stack/data/nova/instances/ac6981be-a618-43d9-9625-c5d1f4bf44af_del complete
Nov 29 07:23:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:20 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ac6981be-a618-43d9-9625-c5d1f4bf44af could not be found.
Nov 29 07:23:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:20 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92ee89c-62a4-41f4-8d08-4d2a74445454]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:20 user nova-compute[75373]: No targets found.
Nov 29 07:23:20 user nova-compute[75373]: iSNS:
Nov 29 07:23:20 user nova-compute[75373]: No targets found.
Nov 29 07:23:20 user nova-compute[75373]: STATIC:
Nov 29 07:23:20 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:20 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:20 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:20 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6
Nov 29 07:23:20 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:20 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:20 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:20 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:20 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:20 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:20 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:20 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:20 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:20 user nova-compute[75373]: No targets found.
Nov 29 07:23:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:20 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:20 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b54ec4-d3de-4965-8b92-37a206cfc9de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d53f72a-af94-4f78-b4b4-8300df8dc2fc]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:20 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b002d8940>, {}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Disconnecting from: [] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== disconnect_volume: return (79ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Preparing to wait for external event volume-reimaged-e6660b83-f4e1-4cef-9d0c-bba9d56e4748 {{(pid=75373) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] No event matching network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 in dict_keys([('volume-reimaged', 'e6660b83-f4e1-4cef-9d0c-bba9d56e4748')]) {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 29 07:23:21 user nova-compute[75373]: WARNING nova.compute.manager [req-4be0da9c-97af-4e12-aee1-a1c8485ad5d0 req-b71d5c2c-cf6c-4eeb-be31-14431998287c service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received unexpected event network-vif-plugged-15b162bd-f8b4-4819-93b2-ef07afc36e14 for instance with vm_state active and task_state rebuilding.
Nov 29 07:23:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtfJBpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:22 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:22 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:22 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[647874db-1696-4f7c-b4be-a36809ff4287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:22 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aed9e5-e053-4bf1-93f7-caeb29dfa3b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b] added
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdffc0b-961a-4a40-b5a9-b879b04ed418]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a1a751-fc62-40c3-ab7b-2d7e59fef15a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtfJBpWQ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RtfJBpWQ" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8768a9-86f2-48db-b1ce-ff976d24c1ae]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RtfJBpWQ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6145b94a-52f2-48e9-98f1-f912bd716ce4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c773e-6b78-4a63-9274-4aebce3748a2]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ff505-1a96-4290-86ce-3ee739b3d3ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260]
Nov 29 07:23:22 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2030b-8b80-485c-b8b1-0764a3e6aea8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec95d95-0037-4ffa-b4fb-1321121f4077]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:22 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6680a36-82b0-416c-bfbd-5ecee9ad4ec0]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtfJBpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23463316231636265', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463316231636265', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lazy-loading 'flavor' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 07:23:23 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:23 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:23:23 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:23 user nova-compute[75373]:   <serial>310d494c-cda3-4bf7-a0e4-9b68c815976b</serial>
Nov 29 07:23:23 user nova-compute[75373]: </disk>
Nov 29 07:23:23 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] No VIF found with MAC fa:16:3e:80:be:83, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-58d73b93-cc9e-41b0-a03e-9af34ed2b104 tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.892s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44', 'serial': 'ac205941-7e70-4989-926a-5c1d6f7cae44'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': '7f30cec8-2d2b-4778-8b74-a940c010584b', 'serial'} {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:24 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547e3e7-856b-4fdb-b1d9-500921253a42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:24 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ec037-fc7b-4f1c-8e0e-784fa9a46bbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44] added
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[afadec58-25de-49b0-8790-9b2206dbaa6a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[11024c60-0cd8-4ce0-b0ce-77e5ad4547b9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuHnDqTB {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IuHnDqTB" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6891c15-bff1-4fe3-8d07-4143a01332af]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IuHnDqTB'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56ed7b-4f18-43eb-9e93-ec9b74b873ae]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6f17e-ec4d-4f43-a65a-1e24c676342c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51c14f-4b50-49a7-a358-08bda2427302]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260]
Nov 29 07:23:24 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5880b431-53b7-439e-9d1f-4212e3995b94]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9106e6a-c674-4a14-bf40-bf8e93e09f08]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:24 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bb216-8bf4-4b6a-b812-e80885fb28a0]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] volume_snapshot_create: create_info: {'snapshot_id': '4ba5afaf-9d72-4b33-b9c4-dec94f39c67c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75373) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] snap xml: <domainsnapshot>
Nov 29 07:23:24 user nova-compute[75373]:   <disks>
Nov 29 07:23:24 user nova-compute[75373]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 29 07:23:24 user nova-compute[75373]:       <source file="/dev/new_file"/>
Nov 29 07:23:24 user nova-compute[75373]:     </disk>
Nov 29 07:23:24 user nova-compute[75373]:     <disk name="vda" snapshot="no"/>
Nov 29 07:23:24 user nova-compute[75373]:   </disks>
Nov 29 07:23:24 user nova-compute[75373]: </domainsnapshot>
Nov 29 07:23:24 user nova-compute[75373]:  {{(pid=75373) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] Lazy-loading 'system_metadata' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:24 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     rv = execute(f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     six.reraise(c, e, tb)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     raise value
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     rv = meth(*args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     self._volume_snapshot_create(context, instance, guest,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     rv = execute(f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     six.reraise(c, e, tb)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     raise value
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     rv = meth(*args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] 
Nov 29 07:23:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-27f33dd4-5ffc-4bfd-a2cc-4380a3007cc1 tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] volume_snapshot_delete: delete_info: {'volume_id': '310d494c-cda3-4bf7-a0e4-9b68c815976b'} {{(pid=75373) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [None req-27f33dd4-5ffc-4bfd-a2cc-4380a3007cc1 tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3]     if delete_info['type'] != 'qcow2':
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] KeyError: 'type'
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4ba5afaf-9d72-4b33-b9c4-dec94f39c67c could not be found.
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4ba5afaf-9d72-4b33-b9c4-dec94f39c67c could not be found. (HTTP 404) (Request-ID: req-5e159409-3f9a-4cd1-8408-3c8ea2e31ef0)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4ba5afaf-9d72-4b33-b9c4-dec94f39c67c could not be found.
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver [None req-27f33dd4-5ffc-4bfd-a2cc-4380a3007cc1 tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a71fd98a-6a3c-4f45-913c-b0dc8a396be5)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 07:23:24 user nova-compute[75373]: ERROR nova.virt.libvirt.driver 
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server [None req-0665a2f4-79dc-4c5c-b983-8cb089d81ade tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server [None req-27f33dd4-5ffc-4bfd-a2cc-4380a3007cc1 tempest-VolumesAssistedSnapshotsTest-660238936 tempest-VolumesAssistedSnapshotsTest-660238936-project] Exception during message handling: KeyError: 'type'
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 07:23:25 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:25 user nova-compute[75373]: INFO nova.compute.manager [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Detaching volume 310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:25 user nova-compute[75373]: INFO nova.virt.block_device [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Attempting to driver detach volume 310d494c-cda3-4bf7-a0e4-9b68c815976b from mountpoint /dev/vdb
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Attempting to detach device vdb from instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:25 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:25 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:23:25 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:25 user nova-compute[75373]:   <serial>310d494c-cda3-4bf7-a0e4-9b68c815976b</serial>
Nov 29 07:23:25 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:25 user nova-compute[75373]: </disk>
Nov 29 07:23:25 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Successfully detached device vdb from instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 from the persistent domain config.
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:25 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:25 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:23:25 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:25 user nova-compute[75373]:   <serial>310d494c-cda3-4bf7-a0e4-9b68c815976b</serial>
Nov 29 07:23:25 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:25 user nova-compute[75373]: </disk>
Nov 29 07:23:25 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26637353233303064', 'path': '/dev/sdg'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353233303064', 'path': '/dev/sdg'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lazy-loading 'flavor' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 336592896 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 788529152 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 930086912 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:30 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd6ef47-2835-4dac-a5d3-3e6e11c8d97e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:30 user nova-compute[75373]: No targets found.
Nov 29 07:23:30 user nova-compute[75373]: iSNS:
Nov 29 07:23:30 user nova-compute[75373]: No targets found.
Nov 29 07:23:30 user nova-compute[75373]: STATIC:
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:30 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:30 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:30 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:30 user nova-compute[75373]: No targets found.
Nov 29 07:23:30 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:30 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:30 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b079e8e7-2132-49a9-a167-c98524637284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a45a7-d1db-4c85-852a-3be427488aa2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:30 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:30 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:30 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0515630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b'): ({'sdd'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Removing single pathed devices sdd {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[efecd2ce-d8de-4406-bd9a-2f782e770001]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad2066-e8b5-412d-bdc5-d3c1eec6883f]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Flushing IO for device /dev/sdd {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[149797fe-9018-4ea8-a82f-da8645417395]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bc817-63d2-466b-af5e-ab55ad463b19]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[78106d60-c977-4d5c-8e9c-b33ed10be638]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a3948-8631-4a5d-ac28-4bfbaa26c58d]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]
Nov 29 07:23:30 user nova-compute[75373]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:30 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aee71c-e25a-4eba-97c1-e483d7fdb0ce]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== disconnect_volume: return (309ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44', 'serial'} {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 07:23:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: removing Cinder connection for volume 7f30cec8-2d2b-4778-8b74-a940c010584b {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 07:23:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: Updating volume 7f30cec8-2d2b-4778-8b74-a940c010584b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "IuHnDqTB", "auth_password": "xwngQTH1R2Piyk", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "ac205941-7e70-4989-926a-5c1d6f7cae44"}, "status": "reserved", "instance": "9eeeba70-7aba-4471-8bd8-6710fc3f5c17", "attached_at": "", "detached_at": "", "volume_id": "ac205941-7e70-4989-926a-5c1d6f7cae44", "serial": "ac205941-7e70-4989-926a-5c1d6f7cae44"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44', 'no_device': None, 'attachment_id': 'b7746c0b-342f-45bd-a1e1-d74cc2bb688c'} {{(pid=75373) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 07:23:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-994c8ee4-d782-4d56-9809-856e17109a6e tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.325s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff4a973-879b-4d5e-bb43-453dc4b35ff0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb5f929-ed7c-426b-9b8f-c45d633cb14d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37dce9-d33b-49e0-9dbf-1e013fb28f67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ceabe9-3da1-4580-9fb9-3fde0d2279df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:32 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1386f8-0406-495b-b11a-b2588e694ed6]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:32 user nova-compute[75373]: INFO nova.compute.manager [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Swapping volume ac205941-7e70-4989-926a-5c1d6f7cae44 for 7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:34 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b791f041-3d5e-4f5f-b354-3651b9238077 is timed out.
Nov 29 07:23:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully detached device vdb from instance b791f041-3d5e-4f5f-b354-3651b9238077 from the live domain config.
Nov 29 07:23:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbMpfPOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:34 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11b210-59f0-4840-8937-e14f42162c2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:34 user nova-compute[75373]: No targets found.
Nov 29 07:23:34 user nova-compute[75373]: iSNS:
Nov 29 07:23:34 user nova-compute[75373]: No targets found.
Nov 29 07:23:34 user nova-compute[75373]: STATIC:
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:34 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:34 user nova-compute[75373]: No targets found.
Nov 29 07:23:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:34 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:34 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cc1c8e-21a6-4c52-b485-42dddfcd0d2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9f25e8-0c09-4b8b-8c2a-2e2e4f31eeee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:34 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae04485e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c6e2e-1408-4e14-8084-f3fbe2f9cf86]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d207e-d822-413a-962e-d21fa1a3cf41]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff8fee-8036-48f6-80ec-2b7911739cd8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.088s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1f4bbc-0528-450d-84d9-b029b0f19719]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52973ea-fcfd-4d70-9459-88dcc0fc7de9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9947438-9b82-4d5f-b27c-721457366221]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260]
Nov 29 07:23:34 user nova-compute[75373]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14d6cda5-213e-487a-a4bb-5fc2bf17e4d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36dfadf-c8ec-4174-9f6f-5e9c7b0ad685]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] <== disconnect_volume: return (464ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:35 user nova-compute[75373]: DEBUG nova.objects.instance [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'flavor' on Instance uuid b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-883884f8-a66e-4061-a25f-23e4e75d3cd2 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.498s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:37 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance a0bb9854-023a-4f26-98e5-5e8e9209c696 is timed out.
Nov 29 07:23:37 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Successfully detached device sdc from instance a0bb9854-023a-4f26-98e5-5e8e9209c696 from the live domain config.
Nov 29 07:23:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSoNmAew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:37 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26cf6b8-ed9d-4b75-a942-7a722905fb6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:37 user nova-compute[75373]: No targets found.
Nov 29 07:23:37 user nova-compute[75373]: iSNS:
Nov 29 07:23:37 user nova-compute[75373]: No targets found.
Nov 29 07:23:37 user nova-compute[75373]: STATIC:
Nov 29 07:23:37 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:37 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:37 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:37 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1
Nov 29 07:23:37 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:37 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:37 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:37 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:37 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:37 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:37 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:37 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:37 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:37 user nova-compute[75373]: No targets found.
Nov 29 07:23:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:37 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:37 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0495d01b-801c-4809-817f-3b55a36c3a1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d15146d-566d-48e2-8895-69ba0b3afe45]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:37 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0448ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2613a677-cb70-4909-b081-d9837b2eb5c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1843619-2e24-4d44-b0ae-8ebdb76d6446]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[639bdfb3-9a8b-483c-9bf9-98ae79d32aef]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc9e25-0012-454f-9131-d3c1e8758366]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c9c72-7148-4f7f-bb31-41e6e44035e3]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd563188-ecd7-4c2d-b000-06eeeff20e87]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260]
Nov 29 07:23:37 user nova-compute[75373]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916b50d3-45ef-494d-92fb-c059c91d73c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[339455ce-2f5d-4e00-9215-89156a73e067]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] <== disconnect_volume: return (334ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c17c669-5de8-4967-a932-6998f4e17637 req-7faef6d3-16fb-4d0a-9e92-84bd31524251 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event volume-reimaged-e6660b83-f4e1-4cef-9d0c-bba9d56e4748 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c17c669-5de8-4967-a932-6998f4e17637 req-7faef6d3-16fb-4d0a-9e92-84bd31524251 service nova] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c17c669-5de8-4967-a932-6998f4e17637 req-7faef6d3-16fb-4d0a-9e92-84bd31524251 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c17c669-5de8-4967-a932-6998f4e17637 req-7faef6d3-16fb-4d0a-9e92-84bd31524251 service nova] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c17c669-5de8-4967-a932-6998f4e17637 req-7faef6d3-16fb-4d0a-9e92-84bd31524251 service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Processing event volume-reimaged-e6660b83-f4e1-4cef-9d0c-bba9d56e4748 {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:23:38 user nova-compute[75373]: INFO nova.virt.block_device [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Booting with volume e6660b83-f4e1-4cef-9d0c-bba9d56e4748 at /dev/vda
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.utils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[de178217-d0ab-4dba-ab54-95b0f07d56b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c459290a-3dfe-44b0-8c0a-9c15ad8cd89d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958f06f-7357-4f0b-a262-a043777f9547]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb16f63-e21a-4400-a51b-62480f49f004]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lazy-loading 'flavor' on Instance uuid a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:23:38 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[67624b7d-e30d-44f8-b378-fb465efcd5d9]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG os_brick.utils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating existing volume attachment record: 57698cd0-fae5-4077-9fff-ecf65e388f19 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b9b55843-20c9-430a-8b74-2723785f0768 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:38 user nova-compute[75373]: INFO nova.compute.manager [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Terminating instance
Nov 29 07:23:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-unplugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] No waiting events found dispatching network-vif-unplugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-2bb8caf3-ac30-4e47-92e4-3dc7fab809d9 req-679e8e22-6b16-4d00-bbd6-84297608e5b9 service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-unplugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:23:39 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 is timed out.
Nov 29 07:23:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully detached device vdb from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the live domain config.
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWbioH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:39 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d1e66a-59ed-4b2b-a19c-25496cdabe91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:39 user nova-compute[75373]: No targets found.
Nov 29 07:23:39 user nova-compute[75373]: iSNS:
Nov 29 07:23:39 user nova-compute[75373]: No targets found.
Nov 29 07:23:39 user nova-compute[75373]: STATIC:
Nov 29 07:23:39 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:39 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:39 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:39 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:39 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:39 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:39 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f
Nov 29 07:23:39 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:39 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:39 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:39 user nova-compute[75373]: No targets found.
Nov 29 07:23:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:39 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:39 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2f713-1708-4281-9bae-e0d6c54d5bf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[432f64c8-5190-4de9-8985-6020b1466580]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:39 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:39 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:39 user nova-compute[75373]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f (non-flash)
Nov 29 07:23:39 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0515b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f'): ({'sdf'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Removing single pathed devices sdf {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8f9a90-20fb-4fe1-b5b7-5e95b8e7a463]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848a16e-d510-4e52-bd47-53f2a1b63b95]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Flushing IO for device /dev/sdf {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05021f85-dbee-4ab6-bfad-e74f9f72920f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeef74c-954e-4a62-95d0-e89e00af72f6]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[10686bbf-dc5b-48c0-a5b8-aee77018f3b0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af851bb-18eb-4c4f-9798-9fdc6e694be3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260]
Nov 29 07:23:39 user nova-compute[75373]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3ebe76-fd87-4cbc-affd-3882590c7a3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a9057e-a564-4918-baeb-1173053fab50]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] <== disconnect_volume: return (349ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Instance destroyed successfully.
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lazy-loading 'resources' on Instance uuid a0bb9854-023a-4f26-98e5-5e8e9209c696 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427904507',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427904507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427904507',id=7,image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw4v6gZQnUDyKQLRoXZS1+MjzR4HkIpns1jVjwWAkXgT0sJgX2Kr+1ZAxbZmlLahUm8mCuvt64m4UbpQ0NtzuOzSPvx8ooAXK4jTRf57FmlCmrGm+AvX69OuzcS/llQzg==',key_name='tempest-keypair-345467278',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bcc8f8d1bf747caa1265b18865e504e',ramdisk_id='',reservation_id='r-mhfmugyh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c92d010-7b8e-456c-8fa3-8fa20dd12870',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1327160197',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1327160197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b584f0452cb44e3ba79b912176e27d1e',uuid=a0bb9854-023a-4f26-98e5-5e8e9209c696,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converting VIF {"id": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "address": "fa:16:3e:aa:14:d0", "network": {"id": "dae386e4-5b24-42b2-ba1d-267f68aa6d87", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-486434068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bcc8f8d1bf747caa1265b18865e504e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f395be8-08", "ovs_interfaceid": "7f395be8-0836-4f70-8d99-8c9a1ea95d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG os_vif [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f395be8-08, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef9025dc-e827-4eeb-a08a-eb8555eeca72) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:39 user nova-compute[75373]: INFO os_vif [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:14:d0,bridge_name='br-int',has_traffic_filtering=True,id=7f395be8-0836-4f70-8d99-8c9a1ea95d07,network=Network(dae386e4-5b24-42b2-ba1d-267f68aa6d87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f395be8-08')
Nov 29 07:23:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Deleting instance files /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696_del
Nov 29 07:23:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Deletion of /opt/stack/data/nova/instances/a0bb9854-023a-4f26-98e5-5e8e9209c696_del complete
Nov 29 07:23:39 user nova-compute[75373]: INFO nova.compute.manager [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 07:23:39 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:23:39 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.volume.cinder [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Update attachment failed for attachment 57698cd0-fae5-4077-9fff-ecf65e388f19. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Traceback (most recent call last):
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self.driver.rebuild(**kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise NotImplementedError()
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] NotImplementedError
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] During handling of the above exception, another exception occurred:
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Traceback (most recent call last):
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     driver_block_device.attach_block_devices(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     _log_and_attach(device)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._do_attach(context, instance, volume, volume_api,
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._volume_attach(context, volume, connector, instance,
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     connection_info = volume_api.attachment_update(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     res = method(self, ctx, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     with excutils.save_and_reraise_exception():
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self.force_reraise()
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise self.value
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return method.func(obj, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     resp = self._update('/attachments/%s' % id, body)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return self.request(url, method, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise exceptions.from_response(resp, body)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b6c8e34f-1a9a-4f6c-8fdb-e1705df105bf tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.compute.utils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27) {{(pid=75373) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Traceback (most recent call last):
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self.driver.rebuild(**kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise NotImplementedError()
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] NotImplementedError
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] During handling of the above exception, another exception occurred:
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Traceback (most recent call last):
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     driver_block_device.attach_block_devices(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     _log_and_attach(device)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._do_attach(context, instance, volume, volume_api,
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._volume_attach(context, volume, connector, instance,
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     connection_info = volume_api.attachment_update(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     res = method(self, ctx, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     with excutils.save_and_reraise_exception():
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self.force_reraise()
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise self.value
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return method.func(obj, *args, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     resp = self._update('/attachments/%s' % id, body)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     return self.request(url, method, **kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise exceptions.from_response(resp, body)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] During handling of the above exception, another exception occurred:
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Traceback (most recent call last):
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     yield
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._do_rebuild_instance_with_claim(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._do_rebuild_instance(
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     self._rebuild_default_impl(**kwargs)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af]     raise exception.InvalidBDM(str(ex))
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:40 user nova-compute[75373]: ERROR nova.compute.manager [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] 
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': '7f30cec8-2d2b-4778-8b74-a940c010584b', 'serial': '7f30cec8-2d2b-4778-8b74-a940c010584b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44'}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44', 'serial'} {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:40 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b9e71-57b5-4a84-a4f8-e8e825869bde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:23:40 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Attempting to detach device tapc9bbc0d9-9f from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] detach device xml: <interface type="ethernet">
Nov 29 07:23:40 user nova-compute[75373]:   <mac address="fa:16:3e:df:e0:74"/>
Nov 29 07:23:40 user nova-compute[75373]:   <model type="virtio"/>
Nov 29 07:23:40 user nova-compute[75373]:   <mtu size="1442"/>
Nov 29 07:23:40 user nova-compute[75373]:   <target dev="tapc9bbc0d9-9f"/>
Nov 29 07:23:40 user nova-compute[75373]: </interface>
Nov 29 07:23:40 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:23:40 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Took 1.09 seconds to deallocate network for instance.
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 07:23:40 user nova-compute[75373]:   <name>instance-00000008</name>
Nov 29 07:23:40 user nova-compute[75373]:   <uuid>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</uuid>
Nov 29 07:23:40 user nova-compute[75373]:   <metadata>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:23:40 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:23:05</nova:creationTime>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:23:40 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:23:40 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:owner>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:23:40 user nova-compute[75373]:   </nova:owner>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:23:40 user nova-compute[75373]:   <nova:ports>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:23:40 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:23:40 user nova-compute[75373]:     </nova:port>
Nov 29 07:23:40 user nova-compute[75373]:     <nova:port uuid="c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd">
Nov 29 07:23:40 user nova-compute[75373]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Nov 29 07:23:40 user nova-compute[75373]:     </nova:port>
Nov 29 07:23:40 user nova-compute[75373]:   </nova:ports>
Nov 29 07:23:40 user nova-compute[75373]: </nova:instance>
Nov 29 07:23:40 user nova-compute[75373]:   </metadata>
Nov 29 07:23:40 user nova-compute[75373]:   <memory unit='KiB'>524288</memory>
Nov 29 07:23:40 user nova-compute[75373]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 07:23:40 user nova-compute[75373]:   <vcpu placement='static'>1</vcpu>
Nov 29 07:23:40 user nova-compute[75373]:   <resource>
Nov 29 07:23:40 user nova-compute[75373]:     <partition>/machine</partition>
Nov 29 07:23:40 user nova-compute[75373]:   </resource>
Nov 29 07:23:40 user nova-compute[75373]:   <sysinfo type='smbios'>
Nov 29 07:23:40 user nova-compute[75373]:     <system>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='version'>0.0.0</entry>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='serial'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='uuid'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:23:40 user nova-compute[75373]:       <entry name='family'>Virtual Machine</entry>
Nov 29 07:23:40 user nova-compute[75373]:     </system>
Nov 29 07:23:40 user nova-compute[75373]:   </sysinfo>
Nov 29 07:23:40 user nova-compute[75373]:   <os>
Nov 29 07:23:40 user nova-compute[75373]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 07:23:40 user nova-compute[75373]:     <boot dev='hd'/>
Nov 29 07:23:40 user nova-compute[75373]:     <smbios mode='sysinfo'/>
Nov 29 07:23:40 user nova-compute[75373]:   </os>
Nov 29 07:23:40 user nova-compute[75373]:   <features>
Nov 29 07:23:40 user nova-compute[75373]:     <acpi/>
Nov 29 07:23:40 user nova-compute[75373]:     <apic/>
Nov 29 07:23:40 user nova-compute[75373]:     <vmcoreinfo state='on'/>
Nov 29 07:23:40 user nova-compute[75373]:   </features>
Nov 29 07:23:40 user nova-compute[75373]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 07:23:40 user nova-compute[75373]:     <model fallback='forbid'>Nehalem</model>
Nov 29 07:23:40 user nova-compute[75373]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 07:23:40 user nova-compute[75373]:     <feature policy='require' name='vme'/>
Nov 29 07:23:40 user nova-compute[75373]:     <feature policy='require' name='x2apic'/>
Nov 29 07:23:40 user nova-compute[75373]:     <feature policy='require' name='hypervisor'/>
Nov 29 07:23:40 user nova-compute[75373]:   </cpu>
Nov 29 07:23:40 user nova-compute[75373]:   <clock offset='utc'>
Nov 29 07:23:40 user nova-compute[75373]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 07:23:40 user nova-compute[75373]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 07:23:40 user nova-compute[75373]:     <timer name='hpet' present='no'/>
Nov 29 07:23:40 user nova-compute[75373]:   </clock>
Nov 29 07:23:40 user nova-compute[75373]:   <on_poweroff>destroy</on_poweroff>
Nov 29 07:23:40 user nova-compute[75373]:   <on_reboot>restart</on_reboot>
Nov 29 07:23:40 user nova-compute[75373]:   <on_crash>destroy</on_crash>
Nov 29 07:23:40 user nova-compute[75373]:   <devices>
Nov 29 07:23:40 user nova-compute[75373]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 07:23:40 user nova-compute[75373]:     <disk type='file' device='disk'>
Nov 29 07:23:40 user nova-compute[75373]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 07:23:40 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk' index='2'/>
Nov 29 07:23:40 user nova-compute[75373]:       <backingStore type='file' index='3'>
Nov 29 07:23:40 user nova-compute[75373]:         <format type='raw'/>
Nov 29 07:23:40 user nova-compute[75373]:         <source file='/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193'/>
Nov 29 07:23:40 user nova-compute[75373]:         <backingStore/>
Nov 29 07:23:40 user nova-compute[75373]:       </backingStore>
Nov 29 07:23:40 user nova-compute[75373]:       <target dev='vda' bus='virtio'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='virtio-disk0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </disk>
Nov 29 07:23:40 user nova-compute[75373]:     <disk type='file' device='cdrom'>
Nov 29 07:23:40 user nova-compute[75373]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 07:23:40 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config' index='1'/>
Nov 29 07:23:40 user nova-compute[75373]:       <backingStore/>
Nov 29 07:23:40 user nova-compute[75373]:       <target dev='hda' bus='ide'/>
Nov 29 07:23:40 user nova-compute[75373]:       <readonly/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='ide0-0-0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </disk>
Nov 29 07:23:40 user nova-compute[75373]:     <controller type='usb' index='0' model='none'>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='usb'/>
Nov 29 07:23:40 user nova-compute[75373]:     </controller>
Nov 29 07:23:40 user nova-compute[75373]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='pci.0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </controller>
Nov 29 07:23:40 user nova-compute[75373]:     <controller type='ide' index='0'>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='ide'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 07:23:40 user nova-compute[75373]:     </controller>
Nov 29 07:23:40 user nova-compute[75373]:     <interface type='ethernet'>
Nov 29 07:23:40 user nova-compute[75373]:       <mac address='fa:16:3e:9a:d0:ac'/>
Nov 29 07:23:40 user nova-compute[75373]:       <target dev='tap7370770a-61'/>
Nov 29 07:23:40 user nova-compute[75373]:       <model type='virtio'/>
Nov 29 07:23:40 user nova-compute[75373]:       <mtu size='1442'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='net0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </interface>
Nov 29 07:23:40 user nova-compute[75373]:     <interface type='ethernet'>
Nov 29 07:23:40 user nova-compute[75373]:       <mac address='fa:16:3e:df:e0:74'/>
Nov 29 07:23:40 user nova-compute[75373]:       <target dev='tapc9bbc0d9-9f'/>
Nov 29 07:23:40 user nova-compute[75373]:       <model type='virtio'/>
Nov 29 07:23:40 user nova-compute[75373]:       <mtu size='1442'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='net1'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </interface>
Nov 29 07:23:40 user nova-compute[75373]:     <serial type='pty'>
Nov 29 07:23:40 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:23:40 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:23:40 user nova-compute[75373]:       <target type='isa-serial' port='0'>
Nov 29 07:23:40 user nova-compute[75373]:         <model name='isa-serial'/>
Nov 29 07:23:40 user nova-compute[75373]:       </target>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </serial>
Nov 29 07:23:40 user nova-compute[75373]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 07:23:40 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:23:40 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:23:40 user nova-compute[75373]:       <target type='serial' port='0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </console>
Nov 29 07:23:40 user nova-compute[75373]:     <input type='mouse' bus='ps2'>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='input0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </input>
Nov 29 07:23:40 user nova-compute[75373]:     <input type='keyboard' bus='ps2'>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='input1'/>
Nov 29 07:23:40 user nova-compute[75373]:     </input>
Nov 29 07:23:40 user nova-compute[75373]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 07:23:40 user nova-compute[75373]:       <listen type='address' address='0.0.0.0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </graphics>
Nov 29 07:23:40 user nova-compute[75373]:     <audio id='1' type='none'/>
Nov 29 07:23:40 user nova-compute[75373]:     <video>
Nov 29 07:23:40 user nova-compute[75373]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='video0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </video>
Nov 29 07:23:40 user nova-compute[75373]:     <memballoon model='virtio'>
Nov 29 07:23:40 user nova-compute[75373]:       <stats period='10'/>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='balloon0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </memballoon>
Nov 29 07:23:40 user nova-compute[75373]:     <rng model='virtio'>
Nov 29 07:23:40 user nova-compute[75373]:       <backend model='random'>/dev/urandom</backend>
Nov 29 07:23:40 user nova-compute[75373]:       <alias name='rng0'/>
Nov 29 07:23:40 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 07:23:40 user nova-compute[75373]:     </rng>
Nov 29 07:23:40 user nova-compute[75373]:   </devices>
Nov 29 07:23:40 user nova-compute[75373]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 07:23:40 user nova-compute[75373]:     <label>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</label>
Nov 29 07:23:40 user nova-compute[75373]:     <imagelabel>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</imagelabel>
Nov 29 07:23:40 user nova-compute[75373]:   </seclabel>
Nov 29 07:23:40 user nova-compute[75373]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 07:23:40 user nova-compute[75373]:     <label>+64055:+108</label>
Nov 29 07:23:40 user nova-compute[75373]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 07:23:40 user nova-compute[75373]:   </seclabel>
Nov 29 07:23:40 user nova-compute[75373]: </domain>
Nov 29 07:23:40 user nova-compute[75373]:  {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 07:23:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully detached device tapc9bbc0d9-9f from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the persistent domain config.
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] (1/8): Attempting to detach device tapc9bbc0d9-9f with device alias net1 from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] detach device xml: <interface type="ethernet">
Nov 29 07:23:40 user nova-compute[75373]:   <mac address="fa:16:3e:df:e0:74"/>
Nov 29 07:23:40 user nova-compute[75373]:   <model type="virtio"/>
Nov 29 07:23:40 user nova-compute[75373]:   <mtu size="1442"/>
Nov 29 07:23:40 user nova-compute[75373]:   <target dev="tapc9bbc0d9-9f"/>
Nov 29 07:23:40 user nova-compute[75373]: </interface>
Nov 29 07:23:40 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32dcd6e-7b86-447a-ab69-07b57c31bf7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b] added
Nov 29 07:23:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec5aca-a9fc-49dd-bf80-8eb3a84a6b28]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.077s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e746d2-88ce-4d0d-aa8f-f6a2c65ee12e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzbVMQan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzbVMQan" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8098764c-ae63-4a76-ba51-34948f50b08e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzbVMQan'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[60479a47-a619-421f-894a-04b514c93f1b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b640c-520f-411e-b28b-70798b87cd4f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab35e962-02fe-4dcb-b272-7d6456e71e07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]
Nov 29 07:23:41 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0053e259-a7fa-4463-aaf6-bc209b9cb2ae]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] Acquiring lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] No waiting events found dispatching network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:41 user nova-compute[75373]: WARNING nova.compute.manager [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received unexpected event network-vif-plugged-7f395be8-0836-4f70-8d99-8c9a1ea95d07 for instance with vm_state deleted and task_state None.
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-426598a5-5263-4e8c-8dd9-3a6e049388dd req-fd8ec87f-4197-46c0-8c79-aa7d246ccf1e service nova] [instance: a0bb9854-023a-4f26-98e5-5e8e9209c696] Received event network-vif-deleted-7f395be8-0836-4f70-8d99-8c9a1ea95d07 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Start waiting for the detach event from libvirt for device tapc9bbc0d9-9f with device alias net1 for instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ad247-eca8-43a3-ab6a-99e970f21a57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbc8e9-4058-459e-a514-d71490a3c52d]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-unplugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-unplugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:41 user nova-compute[75373]: WARNING nova.compute.manager [req-f9a7f048-0a93-4d5e-b0a3-3abec58df561 req-7942be02-e0ad-4d51-a54f-d604474404b3 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-unplugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd for instance with vm_state active and task_state None.
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.520s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Deleted allocations for instance a0bb9854-023a-4f26-98e5-5e8e9209c696
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7a993fc0-e089-4328-ab73-bb8460f50614 tempest-AttachSCSIVolumeTestJSON-1327160197 tempest-AttachSCSIVolumeTestJSON-1327160197-project-member] Lock "a0bb9854-023a-4f26-98e5-5e8e9209c696" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:23:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:42 user nova-compute[75373]: INFO nova.compute.manager [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server [None req-8c17c669-5de8-4967-a932-6998f4e17637 tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e95095bd-e9cd-49a6-a809-2ebd1a548b27)
Nov 29 07:23:42 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23366653534303564', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366653534303564', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lazy-loading 'flavor' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 125829120 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:23:43 user nova-compute[75373]: WARNING nova.compute.manager [req-bee57bbb-c994-4ae6-b859-6855fe9b65ed req-e3d9851e-2593-41a4-9e9a-5685aef0bef9 service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd for instance with vm_state active and task_state None.
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 209715200 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 380633088 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 541065216 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 759169024 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:23:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7244MB free_disk=25.409709930419922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 is timed out.
Nov 29 07:23:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Successfully detached device vdb from instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 from the live domain config.
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RtfJBpWQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:45 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e83dc12-147d-405f-8c4b-24fc2b534cbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:45 user nova-compute[75373]: No targets found.
Nov 29 07:23:45 user nova-compute[75373]: iSNS:
Nov 29 07:23:45 user nova-compute[75373]: No targets found.
Nov 29 07:23:45 user nova-compute[75373]: STATIC:
Nov 29 07:23:45 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:45 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:45 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:45 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b
Nov 29 07:23:45 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:45 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:45 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:45 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:45 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:45 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:45 user nova-compute[75373]: No targets found.
Nov 29 07:23:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:45 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:45 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c7b8f-cb2f-4293-a196-2b83f515e10f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa75728-57d1-460a-a402-d60bc2850cf3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:45 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:45 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:45 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:45 user nova-compute[75373]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b (non-flash)
Nov 29 07:23:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b002300d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa9322-d11d-410e-9832-d33ae056845c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca4d0d-71a5-45b5-925c-b9d26f33b411]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76b875-649f-4a3a-b402-d0fbc1c69352]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a80e23-9018-49a0-b4ae-b4da1c5dff12]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[644c6d16-2b3a-40be-8c66-51ebb8a7c926]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 908066816 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc9125-e7f9-4ec1-9b8f-afc92089a1b5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260]
Nov 29 07:23:46 user nova-compute[75373]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:46 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310d494c-cda3-4bf7-a0e4-9b68c815976b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae417a-6670-471c-94d2-c29c2e98cc7b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] <== disconnect_volume: return (380ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.724s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 1045430272 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.objects.instance [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lazy-loading 'flavor' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IuHnDqTB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'ac205941-7e70-4989-926a-5c1d6f7cae44'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:23:47 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[26631af2-ae43-417e-a5ea-3b29420a1735]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:23:47 user nova-compute[75373]: No targets found.
Nov 29 07:23:47 user nova-compute[75373]: iSNS:
Nov 29 07:23:47 user nova-compute[75373]: No targets found.
Nov 29 07:23:47 user nova-compute[75373]: STATIC:
Nov 29 07:23:47 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:47 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:47 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:47 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44
Nov 29 07:23:47 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:23:47 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:23:47 user nova-compute[75373]: FIRMWARE:
Nov 29 07:23:47 user nova-compute[75373]: No targets found.
Nov 29 07:23:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:23:47 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:23:47 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce943eb-eac0-44c5-a36e-ee55321d7156]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-13daa6d6-9356-465f-a5dd-fcd9ae4661fa tempest-VolumesAssistedSnapshotsTest-1333610417 tempest-VolumesAssistedSnapshotsTest-1333610417-project-admin] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd44558-f434-4818-b11b-d6dee0653567]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:47 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 (non-flash)
Nov 29 07:23:47 user nova-compute[75373]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:23:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae04481f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44'): ({'sdg'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Removing single pathed devices sdg {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd8bda-d694-4fd3-93d1-7c162289405e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3deac05-7ee1-4dfb-9f5f-3bb999f556e9]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Flushing IO for device /dev/sdg {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc9bb9c-c905-4ae6-8b20-ce53c442bdca]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[828787d0-956f-449c-adbc-84ff6b0e6e44]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebf958-0148-4450-bdd3-617f37738dfd]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b29d964-b458-4bde-b75b-833c38efff33]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260]
Nov 29 07:23:47 user nova-compute[75373]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44, portal: 172.16.0.220,3260] successful.
Nov 29 07:23:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac205941-7e70-4989-926a-5c1d6f7cae44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff3605-7486-4777-8b6f-1c87701a60dc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '9eeeba70-7aba-4471-8bd8-6710fc3f5c17', 'attached_at': '', 'detached_at': '', 'volume_id': '7f30cec8-2d2b-4778-8b74-a940c010584b', 'serial'} {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 07:23:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: removing Cinder connection for volume ac205941-7e70-4989-926a-5c1d6f7cae44 {{(pid=75373) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 07:23:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] swap_volume: Updating volume ac205941-7e70-4989-926a-5c1d6f7cae44 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "uzbVMQan", "auth_password": "FEiLxn96q1pOzb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "7f30cec8-2d2b-4778-8b74-a940c010584b"}, "status": "reserved", "instance": "9eeeba70-7aba-4471-8bd8-6710fc3f5c17", "attached_at": "", "detached_at": "", "volume_id": "7f30cec8-2d2b-4778-8b74-a940c010584b", "serial": "7f30cec8-2d2b-4778-8b74-a940c010584b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7f30cec8-2d2b-4778-8b74-a940c010584b', 'no_device': None, 'attachment_id': '7fc5986e-7086-4cd7-8ff6-54baaf4e7074'} {{(pid=75373) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 07:23:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2c7ad97-eb24-446c-ae0c-733145046af0 tempest-TestVolumeSwap-1451163060 tempest-TestVolumeSwap-1451163060-project-admin] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.137s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:23:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:23:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:23:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:49 user nova-compute[75373]: INFO nova.compute.manager [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Detaching volume 7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:23:49 user nova-compute[75373]: INFO nova.virt.block_device [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Attempting to driver detach volume 7f30cec8-2d2b-4778-8b74-a940c010584b from mountpoint /dev/vdb
Nov 29 07:23:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Attempting to detach device vdb from instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:23:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:49 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:49 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:23:49 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:49 user nova-compute[75373]:   <serial>7f30cec8-2d2b-4778-8b74-a940c010584b</serial>
Nov 29 07:23:49 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:49 user nova-compute[75373]: </disk>
Nov 29 07:23:49 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Successfully detached device vdb from instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 from the persistent domain config.
Nov 29 07:23:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:23:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:23:49 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:23:49 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:23:49 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:23:49 user nova-compute[75373]:   <serial>7f30cec8-2d2b-4778-8b74-a940c010584b</serial>
Nov 29 07:23:49 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:23:49 user nova-compute[75373]: </disk>
Nov 29 07:23:49 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:23:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:23:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:23:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Waiting for libvirt event about the detach of device tapc9bbc0d9-9f with device alias net1 from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 is timed out.
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 07:24:01 user nova-compute[75373]:   <name>instance-00000008</name>
Nov 29 07:24:01 user nova-compute[75373]:   <uuid>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</uuid>
Nov 29 07:24:01 user nova-compute[75373]:   <metadata>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:01 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:23:05</nova:creationTime>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:24:01 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:ports>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:ports>
Nov 29 07:24:01 user nova-compute[75373]: </nova:instance>
Nov 29 07:24:01 user nova-compute[75373]:   </metadata>
Nov 29 07:24:01 user nova-compute[75373]:   <memory unit='KiB'>524288</memory>
Nov 29 07:24:01 user nova-compute[75373]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 07:24:01 user nova-compute[75373]:   <vcpu placement='static'>1</vcpu>
Nov 29 07:24:01 user nova-compute[75373]:   <resource>
Nov 29 07:24:01 user nova-compute[75373]:     <partition>/machine</partition>
Nov 29 07:24:01 user nova-compute[75373]:   </resource>
Nov 29 07:24:01 user nova-compute[75373]:   <sysinfo type='smbios'>
Nov 29 07:24:01 user nova-compute[75373]:     <system>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='version'>0.0.0</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='serial'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='uuid'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='family'>Virtual Machine</entry>
Nov 29 07:24:01 user nova-compute[75373]:     </system>
Nov 29 07:24:01 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:01 user nova-compute[75373]:   <os>
Nov 29 07:24:01 user nova-compute[75373]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 07:24:01 user nova-compute[75373]:     <boot dev='hd'/>
Nov 29 07:24:01 user nova-compute[75373]:     <smbios mode='sysinfo'/>
Nov 29 07:24:01 user nova-compute[75373]:   </os>
Nov 29 07:24:01 user nova-compute[75373]:   <features>
Nov 29 07:24:01 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:01 user nova-compute[75373]:     <apic/>
Nov 29 07:24:01 user nova-compute[75373]:     <vmcoreinfo state='on'/>
Nov 29 07:24:01 user nova-compute[75373]:   </features>
Nov 29 07:24:01 user nova-compute[75373]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 07:24:01 user nova-compute[75373]:     <model fallback='forbid'>Nehalem</model>
Nov 29 07:24:01 user nova-compute[75373]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='vme'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='x2apic'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='hypervisor'/>
Nov 29 07:24:01 user nova-compute[75373]:   </cpu>
Nov 29 07:24:01 user nova-compute[75373]:   <clock offset='utc'>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='hpet' present='no'/>
Nov 29 07:24:01 user nova-compute[75373]:   </clock>
Nov 29 07:24:01 user nova-compute[75373]:   <on_poweroff>destroy</on_poweroff>
Nov 29 07:24:01 user nova-compute[75373]:   <on_reboot>restart</on_reboot>
Nov 29 07:24:01 user nova-compute[75373]:   <on_crash>destroy</on_crash>
Nov 29 07:24:01 user nova-compute[75373]:   <devices>
Nov 29 07:24:01 user nova-compute[75373]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='disk'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk' index='2'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore type='file' index='3'>
Nov 29 07:24:01 user nova-compute[75373]:         <format type='raw'/>
Nov 29 07:24:01 user nova-compute[75373]:         <source file='/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193'/>
Nov 29 07:24:01 user nova-compute[75373]:         <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       </backingStore>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='vda' bus='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='virtio-disk0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='cdrom'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config' index='1'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='hda' bus='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <readonly/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide0-0-0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='usb' index='0' model='none'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='usb'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='pci.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='ide' index='0'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <interface type='ethernet'>
Nov 29 07:24:01 user nova-compute[75373]:       <mac address='fa:16:3e:9a:d0:ac'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='tap7370770a-61'/>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <mtu size='1442'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='net0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </interface>
Nov 29 07:24:01 user nova-compute[75373]:     <serial type='pty'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='isa-serial' port='0'>
Nov 29 07:24:01 user nova-compute[75373]:         <model name='isa-serial'/>
Nov 29 07:24:01 user nova-compute[75373]:       </target>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </serial>
Nov 29 07:24:01 user nova-compute[75373]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='serial' port='0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </console>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='mouse' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='keyboard' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 07:24:01 user nova-compute[75373]:       <listen type='address' address='0.0.0.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </graphics>
Nov 29 07:24:01 user nova-compute[75373]:     <audio id='1' type='none'/>
Nov 29 07:24:01 user nova-compute[75373]:     <video>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='video0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </video>
Nov 29 07:24:01 user nova-compute[75373]:     <memballoon model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <stats period='10'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='balloon0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:01 user nova-compute[75373]:     <rng model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <backend model='random'>/dev/urandom</backend>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='rng0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </rng>
Nov 29 07:24:01 user nova-compute[75373]:   </devices>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>+64055:+108</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]: </domain>
Nov 29 07:24:01 user nova-compute[75373]:  {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 07:24:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully detached device tapc9bbc0d9-9f from instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 from the live domain config.
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG os_vif [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9bbc0d9-9f, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95519573-6e80-469a-a176-12f500962b4e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:01 user nova-compute[75373]: INFO os_vif [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f')
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:01 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:24:01</nova:creationTime>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:24:01 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:ports>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:ports>
Nov 29 07:24:01 user nova-compute[75373]: </nova:instance>
Nov 29 07:24:01 user nova-compute[75373]:  {{(pid=75373) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-deleted-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:01 user nova-compute[75373]: INFO nova.compute.manager [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Neutron deleted interface c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd; detaching it from the instance and deleting it from the info cache
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquired lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.objects.instance [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Lazy-loading 'system_metadata' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.objects.instance [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Lazy-loading 'flavor' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.objects.base [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Object Instance<d5f12e85-8ea5-4a78-85c3-c5bf2ad62951> lazy-loaded attributes: system_metadata,flavor {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 07:24:01 user nova-compute[75373]:   <name>instance-00000008</name>
Nov 29 07:24:01 user nova-compute[75373]:   <uuid>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</uuid>
Nov 29 07:24:01 user nova-compute[75373]:   <metadata>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:01 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:24:01</nova:creationTime>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:24:01 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:ports>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:ports>
Nov 29 07:24:01 user nova-compute[75373]: </nova:instance>
Nov 29 07:24:01 user nova-compute[75373]:   </metadata>
Nov 29 07:24:01 user nova-compute[75373]:   <memory unit='KiB'>524288</memory>
Nov 29 07:24:01 user nova-compute[75373]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 07:24:01 user nova-compute[75373]:   <vcpu placement='static'>1</vcpu>
Nov 29 07:24:01 user nova-compute[75373]:   <resource>
Nov 29 07:24:01 user nova-compute[75373]:     <partition>/machine</partition>
Nov 29 07:24:01 user nova-compute[75373]:   </resource>
Nov 29 07:24:01 user nova-compute[75373]:   <sysinfo type='smbios'>
Nov 29 07:24:01 user nova-compute[75373]:     <system>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='version'>0.0.0</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='serial'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='uuid'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='family'>Virtual Machine</entry>
Nov 29 07:24:01 user nova-compute[75373]:     </system>
Nov 29 07:24:01 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:01 user nova-compute[75373]:   <os>
Nov 29 07:24:01 user nova-compute[75373]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 07:24:01 user nova-compute[75373]:     <boot dev='hd'/>
Nov 29 07:24:01 user nova-compute[75373]:     <smbios mode='sysinfo'/>
Nov 29 07:24:01 user nova-compute[75373]:   </os>
Nov 29 07:24:01 user nova-compute[75373]:   <features>
Nov 29 07:24:01 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:01 user nova-compute[75373]:     <apic/>
Nov 29 07:24:01 user nova-compute[75373]:     <vmcoreinfo state='on'/>
Nov 29 07:24:01 user nova-compute[75373]:   </features>
Nov 29 07:24:01 user nova-compute[75373]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 07:24:01 user nova-compute[75373]:     <model fallback='forbid'>Nehalem</model>
Nov 29 07:24:01 user nova-compute[75373]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='vme'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='x2apic'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='hypervisor'/>
Nov 29 07:24:01 user nova-compute[75373]:   </cpu>
Nov 29 07:24:01 user nova-compute[75373]:   <clock offset='utc'>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='hpet' present='no'/>
Nov 29 07:24:01 user nova-compute[75373]:   </clock>
Nov 29 07:24:01 user nova-compute[75373]:   <on_poweroff>destroy</on_poweroff>
Nov 29 07:24:01 user nova-compute[75373]:   <on_reboot>restart</on_reboot>
Nov 29 07:24:01 user nova-compute[75373]:   <on_crash>destroy</on_crash>
Nov 29 07:24:01 user nova-compute[75373]:   <devices>
Nov 29 07:24:01 user nova-compute[75373]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='disk'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk' index='2'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore type='file' index='3'>
Nov 29 07:24:01 user nova-compute[75373]:         <format type='raw'/>
Nov 29 07:24:01 user nova-compute[75373]:         <source file='/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193'/>
Nov 29 07:24:01 user nova-compute[75373]:         <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       </backingStore>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='vda' bus='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='virtio-disk0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='cdrom'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config' index='1'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='hda' bus='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <readonly/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide0-0-0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='usb' index='0' model='none'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='usb'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='pci.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='ide' index='0'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <interface type='ethernet'>
Nov 29 07:24:01 user nova-compute[75373]:       <mac address='fa:16:3e:9a:d0:ac'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='tap7370770a-61'/>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <mtu size='1442'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='net0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </interface>
Nov 29 07:24:01 user nova-compute[75373]:     <serial type='pty'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='isa-serial' port='0'>
Nov 29 07:24:01 user nova-compute[75373]:         <model name='isa-serial'/>
Nov 29 07:24:01 user nova-compute[75373]:       </target>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </serial>
Nov 29 07:24:01 user nova-compute[75373]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='serial' port='0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </console>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='mouse' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='keyboard' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 07:24:01 user nova-compute[75373]:       <listen type='address' address='0.0.0.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </graphics>
Nov 29 07:24:01 user nova-compute[75373]:     <audio id='1' type='none'/>
Nov 29 07:24:01 user nova-compute[75373]:     <video>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='video0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </video>
Nov 29 07:24:01 user nova-compute[75373]:     <memballoon model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <stats period='10'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='balloon0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:01 user nova-compute[75373]:     <rng model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <backend model='random'>/dev/urandom</backend>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='rng0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </rng>
Nov 29 07:24:01 user nova-compute[75373]:   </devices>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>+64055:+108</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]: </domain>
Nov 29 07:24:01 user nova-compute[75373]:  {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface> {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:df:e0:74"/><model type="virtio"/><mtu size="1442"/><target dev="tapc9bbc0d9-9f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 07:24:01 user nova-compute[75373]:   <name>instance-00000008</name>
Nov 29 07:24:01 user nova-compute[75373]:   <uuid>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</uuid>
Nov 29 07:24:01 user nova-compute[75373]:   <metadata>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:01 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:24:01</nova:creationTime>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:24:01 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:ports>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:ports>
Nov 29 07:24:01 user nova-compute[75373]: </nova:instance>
Nov 29 07:24:01 user nova-compute[75373]:   </metadata>
Nov 29 07:24:01 user nova-compute[75373]:   <memory unit='KiB'>524288</memory>
Nov 29 07:24:01 user nova-compute[75373]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 07:24:01 user nova-compute[75373]:   <vcpu placement='static'>1</vcpu>
Nov 29 07:24:01 user nova-compute[75373]:   <resource>
Nov 29 07:24:01 user nova-compute[75373]:     <partition>/machine</partition>
Nov 29 07:24:01 user nova-compute[75373]:   </resource>
Nov 29 07:24:01 user nova-compute[75373]:   <sysinfo type='smbios'>
Nov 29 07:24:01 user nova-compute[75373]:     <system>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='version'>0.0.0</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='serial'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='uuid'>d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</entry>
Nov 29 07:24:01 user nova-compute[75373]:       <entry name='family'>Virtual Machine</entry>
Nov 29 07:24:01 user nova-compute[75373]:     </system>
Nov 29 07:24:01 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:01 user nova-compute[75373]:   <os>
Nov 29 07:24:01 user nova-compute[75373]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 07:24:01 user nova-compute[75373]:     <boot dev='hd'/>
Nov 29 07:24:01 user nova-compute[75373]:     <smbios mode='sysinfo'/>
Nov 29 07:24:01 user nova-compute[75373]:   </os>
Nov 29 07:24:01 user nova-compute[75373]:   <features>
Nov 29 07:24:01 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:01 user nova-compute[75373]:     <apic/>
Nov 29 07:24:01 user nova-compute[75373]:     <vmcoreinfo state='on'/>
Nov 29 07:24:01 user nova-compute[75373]:   </features>
Nov 29 07:24:01 user nova-compute[75373]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 07:24:01 user nova-compute[75373]:     <model fallback='forbid'>Nehalem</model>
Nov 29 07:24:01 user nova-compute[75373]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='vme'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='x2apic'/>
Nov 29 07:24:01 user nova-compute[75373]:     <feature policy='require' name='hypervisor'/>
Nov 29 07:24:01 user nova-compute[75373]:   </cpu>
Nov 29 07:24:01 user nova-compute[75373]:   <clock offset='utc'>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 07:24:01 user nova-compute[75373]:     <timer name='hpet' present='no'/>
Nov 29 07:24:01 user nova-compute[75373]:   </clock>
Nov 29 07:24:01 user nova-compute[75373]:   <on_poweroff>destroy</on_poweroff>
Nov 29 07:24:01 user nova-compute[75373]:   <on_reboot>restart</on_reboot>
Nov 29 07:24:01 user nova-compute[75373]:   <on_crash>destroy</on_crash>
Nov 29 07:24:01 user nova-compute[75373]:   <devices>
Nov 29 07:24:01 user nova-compute[75373]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='disk'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk' index='2'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore type='file' index='3'>
Nov 29 07:24:01 user nova-compute[75373]:         <format type='raw'/>
Nov 29 07:24:01 user nova-compute[75373]:         <source file='/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193'/>
Nov 29 07:24:01 user nova-compute[75373]:         <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       </backingStore>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='vda' bus='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='virtio-disk0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <disk type='file' device='cdrom'>
Nov 29 07:24:01 user nova-compute[75373]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 07:24:01 user nova-compute[75373]:       <source file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/disk.config' index='1'/>
Nov 29 07:24:01 user nova-compute[75373]:       <backingStore/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='hda' bus='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <readonly/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide0-0-0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </disk>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='usb' index='0' model='none'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='usb'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='pci.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <controller type='ide' index='0'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='ide'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </controller>
Nov 29 07:24:01 user nova-compute[75373]:     <interface type='ethernet'>
Nov 29 07:24:01 user nova-compute[75373]:       <mac address='fa:16:3e:9a:d0:ac'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target dev='tap7370770a-61'/>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio'/>
Nov 29 07:24:01 user nova-compute[75373]:       <mtu size='1442'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='net0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </interface>
Nov 29 07:24:01 user nova-compute[75373]:     <serial type='pty'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='isa-serial' port='0'>
Nov 29 07:24:01 user nova-compute[75373]:         <model name='isa-serial'/>
Nov 29 07:24:01 user nova-compute[75373]:       </target>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </serial>
Nov 29 07:24:01 user nova-compute[75373]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 07:24:01 user nova-compute[75373]:       <source path='/dev/pts/6'/>
Nov 29 07:24:01 user nova-compute[75373]:       <log file='/opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951/console.log' append='off'/>
Nov 29 07:24:01 user nova-compute[75373]:       <target type='serial' port='0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='serial0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </console>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='mouse' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <input type='keyboard' bus='ps2'>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='input1'/>
Nov 29 07:24:01 user nova-compute[75373]:     </input>
Nov 29 07:24:01 user nova-compute[75373]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 07:24:01 user nova-compute[75373]:       <listen type='address' address='0.0.0.0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </graphics>
Nov 29 07:24:01 user nova-compute[75373]:     <audio id='1' type='none'/>
Nov 29 07:24:01 user nova-compute[75373]:     <video>
Nov 29 07:24:01 user nova-compute[75373]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='video0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </video>
Nov 29 07:24:01 user nova-compute[75373]:     <memballoon model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <stats period='10'/>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='balloon0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:01 user nova-compute[75373]:     <rng model='virtio'>
Nov 29 07:24:01 user nova-compute[75373]:       <backend model='random'>/dev/urandom</backend>
Nov 29 07:24:01 user nova-compute[75373]:       <alias name='rng0'/>
Nov 29 07:24:01 user nova-compute[75373]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 07:24:01 user nova-compute[75373]:     </rng>
Nov 29 07:24:01 user nova-compute[75373]:   </devices>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>libvirt-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 07:24:01 user nova-compute[75373]:     <label>+64055:+108</label>
Nov 29 07:24:01 user nova-compute[75373]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 07:24:01 user nova-compute[75373]:   </seclabel>
Nov 29 07:24:01 user nova-compute[75373]: </domain>
Nov 29 07:24:01 user nova-compute[75373]:  {{(pid=75373) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 07:24:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Detaching interface fa:16:3e:df:e0:74 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc9bbc0d9-9f' not found.
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Converting VIF {"id": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "address": "fa:16:3e:df:e0:74", "network": {"id": "af72030c-6720-462d-be86-374bb758b622", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1855753955", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9bbc0d9-9f", "ovs_interfaceid": "c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.network.os_vif_util [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG os_vif [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9bbc0d9-9f, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:01 user nova-compute[75373]: INFO os_vif [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e0:74,bridge_name='br-int',has_traffic_filtering=True,id=c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd,network=Network(af72030c-6720-462d-be86-374bb758b622),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9bbc0d9-9f')
Nov 29 07:24:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [req-ccf2fc07-e53d-4918-91d5-33ed82ce9b29 req-1efa5c3c-65af-4f01-a9f7-118d9a060fec service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:01 user nova-compute[75373]:   <nova:package version="0.0.0"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:name>tempest-device-tagging-server-1768516023</nova:name>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:creationTime>2023-11-29 07:24:01</nova:creationTime>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:flavor name="m1.tiny">
Nov 29 07:24:01 user nova-compute[75373]:     <nova:memory>512</nova:memory>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:disk>1</nova:disk>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:swap>0</nova:swap>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:flavor>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:user uuid="2b8794171dae42239ca57e9a36182ca8">tempest-TaggedAttachmentsTest-757260954-project-member</nova:user>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:project uuid="96fdf48c94fd4557ad3f5f3a59c8726b">tempest-TaggedAttachmentsTest-757260954</nova:project>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:owner>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:01 user nova-compute[75373]:   <nova:ports>
Nov 29 07:24:01 user nova-compute[75373]:     <nova:port uuid="7370770a-61cd-4282-aff1-a6c5fa9bb065">
Nov 29 07:24:01 user nova-compute[75373]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:24:01 user nova-compute[75373]:     </nova:port>
Nov 29 07:24:01 user nova-compute[75373]:   </nova:ports>
Nov 29 07:24:01 user nova-compute[75373]: </nova:instance>
Nov 29 07:24:01 user nova-compute[75373]:  {{(pid=75373) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 07:24:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [{"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Releasing lock "refresh_cache-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ba414c43-71fd-400f-bea6-6144f72dd0fc tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "interface-d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-c9bbc0d9-9f0b-4f0b-8569-5680509e3dfd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.484s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:24:05 user nova-compute[75373]: INFO nova.compute.claims [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Claim successful on node user
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:24:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.policy [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbaeb2f9fc3749fb859df41acc075df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6af9d0f931c24042a73455a7ac45e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:24:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Creating image(s)
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "/opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "/opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "/opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.165s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk 1073741824" returned: 0 in 0.055s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Successfully created port: 6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Cannot resize image /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Successfully updated port: 6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquired lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received event network-changed-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Refreshing instance network info cache due to event network-changed-6f77f422-f7de-4e45-9c32-4659d9c6cdcf. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] Acquiring lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Updating instance_info_cache with network_info: [{"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Releasing lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Instance network_info: |[{"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] Acquired lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Refreshing network info cache for port 6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Start _get_guest_xml network_info=[{"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:24:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976443111',display_name='tempest-VolumesAdminNegativeTest-server-1976443111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976443111',id=14,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-eidtagkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:06Z,user_data=None,user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=43152b31-de51-4a18-8f6a-dd1617147fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'pci_devices' on Instance uuid 43152b31-de51-4a18-8f6a-dd1617147fd8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:24:07 user nova-compute[75373]:   <uuid>43152b31-de51-4a18-8f6a-dd1617147fd8</uuid>
Nov 29 07:24:07 user nova-compute[75373]:   <name>instance-0000000e</name>
Nov 29 07:24:07 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:24:07 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:24:07 user nova-compute[75373]:   <metadata>
Nov 29 07:24:07 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:07 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1976443111</nova:name>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:24:07</nova:creationTime>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:24:07 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:07 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:owner>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:user uuid="cbaeb2f9fc3749fb859df41acc075df2">tempest-VolumesAdminNegativeTest-1139418558-project-member</nova:user>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:project uuid="6af9d0f931c24042a73455a7ac45e87d">tempest-VolumesAdminNegativeTest-1139418558</nova:project>
Nov 29 07:24:07 user nova-compute[75373]:       </nova:owner>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:07 user nova-compute[75373]:       <nova:ports>
Nov 29 07:24:07 user nova-compute[75373]:         <nova:port uuid="6f77f422-f7de-4e45-9c32-4659d9c6cdcf">
Nov 29 07:24:07 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:24:07 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:07 user nova-compute[75373]:       </nova:ports>
Nov 29 07:24:07 user nova-compute[75373]:     </nova:instance>
Nov 29 07:24:07 user nova-compute[75373]:   </metadata>
Nov 29 07:24:07 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:24:07 user nova-compute[75373]:     <system>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="serial">43152b31-de51-4a18-8f6a-dd1617147fd8</entry>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="uuid">43152b31-de51-4a18-8f6a-dd1617147fd8</entry>
Nov 29 07:24:07 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:24:07 user nova-compute[75373]:     </system>
Nov 29 07:24:07 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:07 user nova-compute[75373]:   <os>
Nov 29 07:24:07 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:24:07 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:24:07 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:24:07 user nova-compute[75373]:   </os>
Nov 29 07:24:07 user nova-compute[75373]:   <features>
Nov 29 07:24:07 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:07 user nova-compute[75373]:     <apic/>
Nov 29 07:24:07 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:24:07 user nova-compute[75373]:   </features>
Nov 29 07:24:07 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:24:07 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:24:07 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:24:07 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:24:07 user nova-compute[75373]:   </clock>
Nov 29 07:24:07 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:24:07 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:24:07 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:24:07 user nova-compute[75373]:   </cpu>
Nov 29 07:24:07 user nova-compute[75373]:   <devices>
Nov 29 07:24:07 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:24:07 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:24:07 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk"/>
Nov 29 07:24:07 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:24:07 user nova-compute[75373]:     </disk>
Nov 29 07:24:07 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:07 user nova-compute[75373]:       <mac address="fa:16:3e:e8:55:48"/>
Nov 29 07:24:07 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:07 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:07 user nova-compute[75373]:       <target dev="tap6f77f422-f7"/>
Nov 29 07:24:07 user nova-compute[75373]:     </interface>
Nov 29 07:24:07 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:24:07 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/console.log" append="off"/>
Nov 29 07:24:07 user nova-compute[75373]:     </serial>
Nov 29 07:24:07 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:24:07 user nova-compute[75373]:     <video>
Nov 29 07:24:07 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:07 user nova-compute[75373]:     </video>
Nov 29 07:24:07 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:24:07 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:24:07 user nova-compute[75373]:     </rng>
Nov 29 07:24:07 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:24:07 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:24:07 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:24:07 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:07 user nova-compute[75373]:   </devices>
Nov 29 07:24:07 user nova-compute[75373]: </domain>
Nov 29 07:24:07 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976443111',display_name='tempest-VolumesAdminNegativeTest-server-1976443111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976443111',id=14,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-eidtagkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:06Z,user_data=None,user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=43152b31-de51-4a18-8f6a-dd1617147fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG os_vif [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '035cfded-296c-5157-acf2-da5401639d09', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f77f422-f7, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f77f422-f7, col_values=(('qos', UUID('ac7689a9-f839-4f74-b759-5b8a2e1af8fa')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f77f422-f7, col_values=(('external_ids', {'iface-id': '6f77f422-f7de-4e45-9c32-4659d9c6cdcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:55:48', 'vm-uuid': '43152b31-de51-4a18-8f6a-dd1617147fd8'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:07 user nova-compute[75373]: INFO os_vif [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7')
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] No VIF found with MAC fa:16:3e:e8:55:48, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Updated VIF entry in instance network info cache for port 6f77f422-f7de-4e45-9c32-4659d9c6cdcf. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Updating instance_info_cache with network_info: [{"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9132b7ac-9128-4782-b0de-37590af5261d req-787f3d88-3d84-4688-a27f-d93638aeff95 service nova] Releasing lock "refresh_cache-43152b31-de51-4a18-8f6a-dd1617147fd8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] No waiting events found dispatching network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:08 user nova-compute[75373]: WARNING nova.compute.manager [req-89e5ecd9-02f0-4f35-822b-506eb0bb31d3 req-c57e25bd-1cd9-486c-bcf2-5597842a8b23 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received unexpected event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf for instance with vm_state building and task_state spawning.
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:09 user nova-compute[75373]: INFO nova.compute.manager [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Terminating instance
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] During wait destroy, instance disappeared. {{(pid=75373) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 29 07:24:09 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Instance destroyed successfully.
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lazy-loading 'resources' on Instance uuid ac6981be-a618-43d9-9625-c5d1f4bf44af {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:21:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2098770352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1731604959',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj5lOuo2NgeQuJc1EeqhFrPQTlo3rztBiBFN5Ls5P7xd9gRbs8HW82uuSUKiTBRWH9JkcRm+sul7gaTvLCM5tv6bU4sOGiKXl36ceWXwKisnvpxSxEK96TGSNRs3SYvbg==',key_name='tempest-keypair-2040077326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb1f69b2da347f59a3b3db01e2af757',ramdisk_id='',reservation_id='r-jxan4x7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1718834869',owner_user_name='tempest-ServerActionsV293TestJSON-1718834869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a4923a7b67f843fd962dcb7df6e26e73',uuid=ac6981be-a618-43d9-9625-c5d1f4bf44af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converting VIF {"id": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "address": "fa:16:3e:65:5b:29", "network": {"id": "163f55b8-9123-4ac5-a0b8-c4f74ebeb922", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-516883615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb1f69b2da347f59a3b3db01e2af757", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15b162bd-f8", "ovs_interfaceid": "15b162bd-f8b4-4819-93b2-ef07afc36e14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_vif [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15b162bd-f8, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:09 user nova-compute[75373]: INFO os_vif [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:29,bridge_name='br-int',has_traffic_filtering=True,id=15b162bd-f8b4-4819-93b2-ef07afc36e14,network=Network(163f55b8-9123-4ac5-a0b8-c4f74ebeb922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15b162bd-f8')
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHViLgZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:09 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4dbb23-31f0-44d1-8288-ede49132361b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:24:09 user nova-compute[75373]: No targets found.
Nov 29 07:24:09 user nova-compute[75373]: iSNS:
Nov 29 07:24:09 user nova-compute[75373]: No targets found.
Nov 29 07:24:09 user nova-compute[75373]: STATIC:
Nov 29 07:24:09 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:24:09 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:24:09 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:24:09 user nova-compute[75373]: FIRMWARE:
Nov 29 07:24:09 user nova-compute[75373]: No targets found.
Nov 29 07:24:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:24:09 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:24:09 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6660b83-f4e1-4cef-9d0c-bba9d56e4748', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[729653d2-ef40-44ba-aa61-c9bdbf4c01e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe0788-9c1b-4a6b-8012-36ad33ceea0c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:24:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:24:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b002d8940>, {}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Disconnecting from: [] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] <== disconnect_volume: return (75ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:24:09 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Deletion of /opt/stack/data/nova/instances/ac6981be-a618-43d9-9625-c5d1f4bf44af_del complete
Nov 29 07:24:09 user nova-compute[75373]: INFO nova.compute.manager [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Took 0.18 seconds to destroy the instance on the hypervisor.
Nov 29 07:24:09 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:24:09 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 is timed out.
Nov 29 07:24:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Successfully detached device vdb from instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 from the live domain config.
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzbVMQan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '7f30cec8-2d2b-4778-8b74-a940c010584b'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:10 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feae9b4-56e3-43e2-bd98-69afb4e8f83e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:24:10 user nova-compute[75373]: No targets found.
Nov 29 07:24:10 user nova-compute[75373]: iSNS:
Nov 29 07:24:10 user nova-compute[75373]: No targets found.
Nov 29 07:24:10 user nova-compute[75373]: STATIC:
Nov 29 07:24:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b
Nov 29 07:24:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:24:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:24:10 user nova-compute[75373]: FIRMWARE:
Nov 29 07:24:10 user nova-compute[75373]: No targets found.
Nov 29 07:24:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:24:10 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:24:10 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[521c2982-f293-4e22-97cd-72b3c3cdc7e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d558a2b-6e07-49c0-8d8c-4e898252c6aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:24:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b (non-flash)
Nov 29 07:24:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae04f1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1c54c-d054-4a09-a619-2cb0351fc71b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8274d9eb-8534-459b-9ef3-69279bf14253]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd69203-7d51-4924-b649-27a3640b1122]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be3a90-7768-49e7-b411-865297ca86b3]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfcf6d-72a0-4aee-959f-3e9db233508f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82f18b-fe28-4c33-826b-3f5da65399ca]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260]
Nov 29 07:24:10 user nova-compute[75373]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f30cec8-2d2b-4778-8b74-a940c010584b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[92891477-1199-43da-8741-8333a49ac2c8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] <== disconnect_volume: return (327ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:24:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Instance spawned successfully.
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] No waiting events found dispatching network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:11 user nova-compute[75373]: WARNING nova.compute.manager [req-468864c3-8a4f-43ef-868d-e0af99b951b0 req-96223d5e-8796-4de4-be03-c61cb8bfdb93 service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received unexpected event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf for instance with vm_state building and task_state spawning.
Nov 29 07:24:11 user nova-compute[75373]: INFO nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:11 user nova-compute[75373]: INFO nova.compute.manager [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Took 6.01 seconds to build instance.
Nov 29 07:24:11 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Took 1.18 seconds to deallocate network for instance.
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3ab1f46f-43ba-400d-a511-1da93f1ec053 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.114s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:11 user nova-compute[75373]: INFO nova.compute.manager [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Took 0.08 seconds to detach 1 volumes for instance.
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Deleting volume: e6660b83-f4e1-4cef-9d0c-bba9d56e4748 {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lazy-loading 'flavor' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f14cff8e-009b-40fe-ad28-f787ffd2986c tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9472b181-180c-40ae-8854-84b8faaca9bd tempest-ServerActionsV293TestJSON-1718834869 tempest-ServerActionsV293TestJSON-1718834869-project-member] Lock "ac6981be-a618-43d9-9625-c5d1f4bf44af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-27b1e893-c784-4cc9-be08-a63649ed3b6f req-651ee622-5e9d-457d-9c58-cf661ed48e1e service nova] [instance: ac6981be-a618-43d9-9625-c5d1f4bf44af] Received event network-vif-deleted-15b162bd-f8b4-4819-93b2-ef07afc36e14 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-changed-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Refreshing instance network info cache due to event network-changed-169647ce-fc89-404b-aebc-c942b87b4d6e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] Acquiring lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] Acquired lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Refreshing network info cache for port 169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updated VIF entry in instance network info cache for port 169647ce-fc89-404b-aebc-c942b87b4d6e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating instance_info_cache with network_info: [{"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b6872f7-8115-47e8-af58-d93eb67532d2 req-495ee383-c49a-45fa-ac8a-c78a5e577f16 service nova] Releasing lock "refresh_cache-adaf3c5c-6d17-44db-a652-1fafcc3aeefc" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG nova.objects.instance [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:14 user nova-compute[75373]: INFO nova.compute.manager [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attaching volume 83e2f25a-96f2-404a-b023-ccaa9eb6ec1b to /dev/vdb
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.utils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c3231-9af4-4451-b0d9-15df4acc5cf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c913bd98-3075-4bc6-92ff-896d0da1e2fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[571b450d-2bb5-498a-9b3c-8b5131d9ef83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b280c-e366-42db-a9f0-92f753556c07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:14 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:24:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0066e33-1c64-4f9a-9890-9ef40032bc15]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG os_brick.utils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:14 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating existing volume attachment record: 3c9703a0-dce0-4fbd-9fa8-b3d4a7290a5d {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:24:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:24:19 user nova-compute[75373]: INFO nova.compute.claims [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Claim successful on node user
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:20 user nova-compute[75373]: INFO nova.compute.manager [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Terminating instance
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.968s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:24:20 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:24:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-e188aad8-8462-4f09-b3b5-107ec1279a43 req-387c4904-d97d-4fd0-97fa-7e012214b80d service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:24:21 user nova-compute[75373]: INFO nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Booting with volume 47080dae-d789-444a-8c83-79565c738f26 at /dev/vda
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.policy [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f41fb36b68d94cef8551b930eed284d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b2a7d8ed704aeaabb2d865f78704d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[800a5774-6e21-4d0a-a050-7c5e3e9249cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[61797189-8fd4-448a-801b-562044fe15c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26c74d-bb7a-4e0f-ad12-21c090b8f5bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0002f52-d53a-4614-90d2-d23b4e4f9db2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:21 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[118936e3-fb38-47e1-93a6-c1a6fbfd4783]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating existing volume attachment record: 7591878f-d34b-4430-a70f-500dc3b32a26 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Instance destroyed successfully.
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.objects.instance [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lazy-loading 'resources' on Instance uuid 426b9987-09a0-4c2a-8a51-7cc528b1b5e3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-637812550',display_name='tempest-VolumesAssistedSnapshotsTest-server-637812550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-637812550',id=10,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD29z5YGe2lyZDQFGIKNsbuqcB/pik7E4ieYcHIgzO9ZIv7kBp4m4aC+82qUXNpUyK2LAd+vp1i+fq+B4JGOoZkJpbI040eQCzQHrCGNYnrgsqEY5WHVmYow7XGN46aOBg==',key_name='tempest-keypair-788485080',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='719e066d33ad4729aecc4463fd30b424',ramdisk_id='',reservation_id='r-4dqfpi8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-871024869',owner_user_name='tempest-VolumesAssistedSnapshotsTest-871024869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3af2dcba2de142a3956137ceeef8ee5a',uuid=426b9987-09a0-4c2a-8a51-7cc528b1b5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converting VIF {"id": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "address": "fa:16:3e:80:be:83", "network": {"id": "98127126-bc99-49e9-a5ca-78f950fd3595", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-59436105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "719e066d33ad4729aecc4463fd30b424", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc24501-f3", "ovs_interfaceid": "ecc24501-f3af-41e1-a92d-a3b6a7cd5b91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG os_vif [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc24501-f3, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a590003-cf7c-454f-98c4-cdda0a46d9e2) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: INFO os_vif [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:be:83,bridge_name='br-int',has_traffic_filtering=True,id=ecc24501-f3af-41e1-a92d-a3b6a7cd5b91,network=Network(98127126-bc99-49e9-a5ca-78f950fd3595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc24501-f3')
Nov 29 07:24:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Deleting instance files /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3_del
Nov 29 07:24:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Deletion of /opt/stack/data/nova/instances/426b9987-09a0-4c2a-8a51-7cc528b1b5e3_del complete
Nov 29 07:24:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:21 user nova-compute[75373]: INFO nova.compute.manager [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 29 07:24:21 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:24:21 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully created port: 7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully created port: c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state active and task_state deleting.
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state active and task_state deleting.
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state active and task_state deleting.
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e6e3135-c97a-4966-b8f3-9ca444cb6b70 req-2f0e05e4-aee9-4b8d-b0b1-278fee0c21c6 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-unplugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:23 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Took 1.47 seconds to deallocate network for instance.
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully created port: 9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLCogyte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:23 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5da2d4-3879-4ba1-8233-1333db4e954d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:24:23 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6fa3d-f366-4855-b6c2-055f6b187a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b] added
Nov 29 07:24:23 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a33d7-3242-411a-9e2b-53094575b5d9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af44bb4-dd52-40fb-b5e9-3b6f5852de11]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLCogyte {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLCogyte" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c5f839-837f-4b7b-8b98-be699b7ba757]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xLCogyte'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd243848-a630-416b-b3ac-d2f859881bf5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4683b6c-e730-4520-8253-c9479f1e1205]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:24:23 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:24:23 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:23 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:24:23 user nova-compute[75373]: 
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcf0fb0-dfb3-476e-b3d7-6741c519eda2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260]
Nov 29 07:24:23 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:23 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[598cb002-de6d-4750-adda-31067246f152]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8a8b79-70d5-4a17-8048-afa9b7426979]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:23 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:23 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653ad0a-6e6e-4cf5-93a9-47ce3956c79f]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLCogyte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:23 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Deleted allocations for instance 426b9987-09a0-4c2a-8a51-7cc528b1b5e3
Nov 29 07:24:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-dc855e73-28ec-4ee1-9331-468310a84a83 tempest-VolumesAssistedSnapshotsTest-871024869 tempest-VolumesAssistedSnapshotsTest-871024869-project-member] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully created port: e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully created port: 5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23561333265336132', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561333265336132', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:24:24 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:24 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:24:24 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:24:24 user nova-compute[75373]:   <serial>83e2f25a-96f2-404a-b023-ccaa9eb6ec1b</serial>
Nov 29 07:24:24 user nova-compute[75373]: </disk>
Nov 29 07:24:24 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] Acquiring lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] Lock "426b9987-09a0-4c2a-8a51-7cc528b1b5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] No waiting events found dispatching network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:25 user nova-compute[75373]: WARNING nova.compute.manager [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received unexpected event network-vif-plugged-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 for instance with vm_state deleted and task_state None.
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-c6d7a726-62d7-4d41-b8d7-ccbf73f2bcf8 req-4dff8196-f49a-45ca-b630-b498037830d3 service nova] [instance: 426b9987-09a0-4c2a-8a51-7cc528b1b5e3] Received event network-vif-deleted-ecc24501-f3af-41e1-a92d-a3b6a7cd5b91 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No VIF found with MAC fa:16:3e:2b:c0:0d, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: 7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-7a84e996-fae2-4711-a6bb-80ca3fd97842. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port 7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-564dff7e-3730-4a11-bf26-0a1d2ef3953e tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.737s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0e40a414-661a-4a05-8852-e4e00f6f0670 req-4ad4bfeb-6211-435e-8837-0eea1505c9e7 service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:26 user nova-compute[75373]: INFO nova.compute.manager [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Terminating instance
Nov 29 07:24:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-unplugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] No waiting events found dispatching network-vif-unplugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a25dc34-2e27-44bf-9c19-f02267962b3d req-b0d9eae2-5c45-40a0-a8d5-61d8e951b7db service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-unplugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Instance destroyed successfully.
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lazy-loading 'resources' on Instance uuid ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-666885323',display_name='tempest-ServersNegativeTestJSON-server-666885323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-666885323',id=13,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-x58tklp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:22:45Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "address": "fa:16:3e:14:7b:36", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b1b1a5-4d", "ovs_interfaceid": "63b1b1a5-4d8a-4fd9-8a19-1bde7852977d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG os_vif [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63b1b1a5-4d, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=136213ec-30cb-422a-bfa8-b1aedbafd97e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:27 user nova-compute[75373]: INFO os_vif [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7b:36,bridge_name='br-int',has_traffic_filtering=True,id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b1b1a5-4d')
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Deleting instance files /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281_del
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Deletion of /opt/stack/data/nova/instances/ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281_del complete
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.compute.manager [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-c2705e34-182d-4ae7-b800-9c9912042fe8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Took 0.68 seconds to deallocate network for instance.
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-33c10210-74e1-47c3-8919-7d44c7631248 req-b1f40e90-aad8-40bd-a401-1f529d8166e7 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-deleted-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:27 user nova-compute[75373]: INFO nova.compute.manager [req-33c10210-74e1-47c3-8919-7d44c7631248 req-b1f40e90-aad8-40bd-a401-1f529d8166e7 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Neutron deleted interface 63b1b1a5-4d8a-4fd9-8a19-1bde7852977d; detaching it from the instance and deleting it from the info cache
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-33c10210-74e1-47c3-8919-7d44c7631248 req-b1f40e90-aad8-40bd-a401-1f529d8166e7 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-33c10210-74e1-47c3-8919-7d44c7631248 req-b1f40e90-aad8-40bd-a401-1f529d8166e7 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Detach interface failed, port_id=63b1b1a5-4d8a-4fd9-8a19-1bde7852977d, reason: Instance ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.network.neutron [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-50951f3a-11e6-4cb6-925e-4d9c98b08d07 req-e1c62159-3d98-4c35-a26b-5135126d3af6 service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:28 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Deleted allocations for instance ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: 9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef7dd555-74d6-4136-b284-01eae99a90c3 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.objects.instance [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:28 user nova-compute[75373]: INFO nova.compute.manager [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attaching volume 573f7800-8f59-48ef-b683-980b00b1d168 to /dev/vdc
Nov 29 07:24:28 user nova-compute[75373]: DEBUG os_brick.utils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] Acquiring lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] Lock "ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] No waiting events found dispatching network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:28 user nova-compute[75373]: WARNING nova.compute.manager [req-26ef038c-dc16-48ae-99ba-be0b652f6223 req-17930131-0cf9-4a08-9a55-9eb4765faf25 service nova] [instance: ed7fa6cf-08a1-4eb8-bb28-31dcf01cc281] Received unexpected event network-vif-plugged-63b1b1a5-4d8a-4fd9-8a19-1bde7852977d for instance with vm_state deleted and task_state None.
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[75636d73-d41c-4fc4-9a6c-5481672d4d59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a542b19-5143-4476-af86-f39f48149f71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f790fa66-78aa-4fb4-b768-1dca54ef4f12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c040ca1-a934-4393-8f5e-675241b216f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:29 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9819e7dc-f96a-47fd-bae4-69c906cb35f4]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.utils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating existing volume attachment record: a8c08915-902a-4d35-b1be-0d6431d03391 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-c93148e8-f2a6-4191-8c81-f2ff29f44cde. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:29 user nova-compute[75373]: INFO nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Booting with volume 1c138c9e-e639-4adf-aeb3-fb72ff8ec83f at /dev/vdb
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ae657-bf1d-49c8-818e-42f43ae9c2c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71681b-965e-43b1-b1c6-8546ddf96207]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4d360f-5397-463d-9b50-2d381a172c1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e42559-31fe-4625-805c-c7af588d4ad1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:29 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00a3a72-52f0-4e4f-8879-0e25b78b4894]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating existing volume attachment record: 138fd2bc-e5c5-4cc4-98f3-26d43763ade7 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Successfully updated port: 5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-9159dced-a86c-4765-b9e3-f56b4b8fed6e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port 9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-e1a4e104-89bb-4e60-aafb-57f204444966. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e0b92f2-558b-470f-82eb-f0076e1660ff req-7f096031-2f89-4c18-9dc7-1e141bc9381a service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:24:30 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-5cc47e13-b920-426a-9ffe-c000c6678b7d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:31 user nova-compute[75373]: INFO nova.compute.manager [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Terminating instance
Nov 29 07:24:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Instance destroyed successfully.
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lazy-loading 'resources' on Instance uuid d5f12e85-8ea5-4a78-85c3-c5bf2ad62951 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1768516023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1768516023',id=8,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwmXuW0JwzlTuiW5JvCYCplWyW7ryYUW8DpbLnLxSC59tjnYpgvzznk7eNMvsjHXIEWQR4vRYmhuHu5GTTkHM082XbO9WHESDP8+e8155M1OkiPa040N9w4FBtB+eoLZw==',key_name='tempest-keypair-1596201294',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96fdf48c94fd4557ad3f5f3a59c8726b',ramdisk_id='',reservation_id='r-fuhu2scl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-757260954',owner_user_name='tempest-TaggedAttachmentsTest-757260954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b8794171dae42239ca57e9a36182ca8',uuid=d5f12e85-8ea5-4a78-85c3-c5bf2ad62951,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converting VIF {"id": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "address": "fa:16:3e:9a:d0:ac", "network": {"id": "41e53a6b-36de-4460-a76c-5b7e9912ed4b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-295300008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96fdf48c94fd4557ad3f5f3a59c8726b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7370770a-61", "ovs_interfaceid": "7370770a-61cd-4282-aff1-a6c5fa9bb065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG os_vif [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7370770a-61, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83d1e116-02e9-459c-a460-f8bf4ae8c9cd) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:32 user nova-compute[75373]: INFO os_vif [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:d0:ac,bridge_name='br-int',has_traffic_filtering=True,id=7370770a-61cd-4282-aff1-a6c5fa9bb065,network=Network(41e53a6b-36de-4460-a76c-5b7e9912ed4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7370770a-61')
Nov 29 07:24:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Deleting instance files /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951_del
Nov 29 07:24:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Deletion of /opt/stack/data/nova/instances/d5f12e85-8ea5-4a78-85c3-c5bf2ad62951_del complete
Nov 29 07:24:32 user nova-compute[75373]: INFO nova.compute.manager [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 07:24:32 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:24:32 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:33 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Took 0.79 seconds to deallocate network for instance.
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-unplugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-unplugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:33 user nova-compute[75373]: WARNING nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-unplugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 for instance with vm_state deleted and task_state None.
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Acquiring lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] No waiting events found dispatching network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:33 user nova-compute[75373]: WARNING nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received unexpected event network-vif-plugged-7370770a-61cd-4282-aff1-a6c5fa9bb065 for instance with vm_state deleted and task_state None.
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ac503d3-48d7-44ff-8702-cd5de4ac658c req-60e9654e-1987-422a-9872-472950c2234e service nova] [instance: d5f12e85-8ea5-4a78-85c3-c5bf2ad62951] Received event network-vif-deleted-7370770a-61cd-4282-aff1-a6c5fa9bb065 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance network_info: |[{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.network.neutron [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port 5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:33 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.194s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:24:34 user nova-compute[75373]: INFO nova.compute.claims [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Claim successful on node user
Nov 29 07:24:34 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Deleted allocations for instance d5f12e85-8ea5-4a78-85c3-c5bf2ad62951
Nov 29 07:24:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef43edba-9505-4daa-971d-5152cf8709d1 tempest-TaggedAttachmentsTest-757260954 tempest-TaggedAttachmentsTest-757260954-project-member] Lock "d5f12e85-8ea5-4a78-85c3-c5bf2ad62951" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updated VIF entry in instance network info cache for port 5cc47e13-b920-426a-9ffe-c000c6678b7d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adfb56a1-d37b-44f5-95a7-53288b29aa6e req-e1e17c4e-fb5d-4128-8104-b019590e33c7 service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:24:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:24:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG nova.policy [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3d603a0cab4a7da1c743c26b73540d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f10657321e44f49a30fedbe20dddcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:24:35 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Creating image(s)
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "/opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "/opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.217s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.238s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk 1073741824" returned: 0 in 0.057s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.209s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:35 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Successfully created port: 69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Cannot resize image /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Ensure instance console log exists: /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Successfully updated port: 69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-changed-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Refreshing instance network info cache due to event network-changed-69034705-573c-4d5e-8ba1-db0cab8e23c4. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] Acquiring lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating instance_info_cache with network_info: [{"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Instance network_info: |[{"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] Acquired lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Refreshing network info cache for port 69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Start _get_guest_xml network_info=[{"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:24:37 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:37 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1195464956',display_name='tempest-tempest.common.compute-instance-1195464956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1195464956',id=16,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRsyHbG85w5HbekWqoBkp9Q3xxhdnfF9fbtrQ2lHMPLX3XKgW+qiLfO8CukIk9RO9oEjdOjWIiDWegj2ermUs3oLFNXiCJogCzxUmEkjsZuW1o4Vk5MNAGNdNONe0aslg==',key_name='tempest-keypair-1354867634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-q8n3hu8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=7e23b02c-d997-46bc-b785-51fb6ce167ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e23b02c-d997-46bc-b785-51fb6ce167ee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:24:37 user nova-compute[75373]:   <uuid>7e23b02c-d997-46bc-b785-51fb6ce167ee</uuid>
Nov 29 07:24:37 user nova-compute[75373]:   <name>instance-00000010</name>
Nov 29 07:24:37 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:24:37 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:24:37 user nova-compute[75373]:   <metadata>
Nov 29 07:24:37 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:37 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:name>tempest-tempest.common.compute-instance-1195464956</nova:name>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:24:37</nova:creationTime>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:24:37 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:37 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:owner>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:user uuid="fd3d603a0cab4a7da1c743c26b73540d">tempest-ServerActionsTestOtherA-1926007529-project-member</nova:user>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:project uuid="b3f10657321e44f49a30fedbe20dddcf">tempest-ServerActionsTestOtherA-1926007529</nova:project>
Nov 29 07:24:37 user nova-compute[75373]:       </nova:owner>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:37 user nova-compute[75373]:       <nova:ports>
Nov 29 07:24:37 user nova-compute[75373]:         <nova:port uuid="69034705-573c-4d5e-8ba1-db0cab8e23c4">
Nov 29 07:24:37 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:24:37 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:37 user nova-compute[75373]:       </nova:ports>
Nov 29 07:24:37 user nova-compute[75373]:     </nova:instance>
Nov 29 07:24:37 user nova-compute[75373]:   </metadata>
Nov 29 07:24:37 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:24:37 user nova-compute[75373]:     <system>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="serial">7e23b02c-d997-46bc-b785-51fb6ce167ee</entry>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="uuid">7e23b02c-d997-46bc-b785-51fb6ce167ee</entry>
Nov 29 07:24:37 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:24:37 user nova-compute[75373]:     </system>
Nov 29 07:24:37 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:37 user nova-compute[75373]:   <os>
Nov 29 07:24:37 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:24:37 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:24:37 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:24:37 user nova-compute[75373]:   </os>
Nov 29 07:24:37 user nova-compute[75373]:   <features>
Nov 29 07:24:37 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:37 user nova-compute[75373]:     <apic/>
Nov 29 07:24:37 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:24:37 user nova-compute[75373]:   </features>
Nov 29 07:24:37 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:24:37 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:24:37 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:24:37 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:24:37 user nova-compute[75373]:   </clock>
Nov 29 07:24:37 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:24:37 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:24:37 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:24:37 user nova-compute[75373]:   </cpu>
Nov 29 07:24:37 user nova-compute[75373]:   <devices>
Nov 29 07:24:37 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:24:37 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:24:37 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk"/>
Nov 29 07:24:37 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:24:37 user nova-compute[75373]:     </disk>
Nov 29 07:24:37 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:37 user nova-compute[75373]:       <mac address="fa:16:3e:63:24:b4"/>
Nov 29 07:24:37 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:37 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:37 user nova-compute[75373]:       <target dev="tap69034705-57"/>
Nov 29 07:24:37 user nova-compute[75373]:     </interface>
Nov 29 07:24:37 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:24:37 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/console.log" append="off"/>
Nov 29 07:24:37 user nova-compute[75373]:     </serial>
Nov 29 07:24:37 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:24:37 user nova-compute[75373]:     <video>
Nov 29 07:24:37 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:37 user nova-compute[75373]:     </video>
Nov 29 07:24:37 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:24:37 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:24:37 user nova-compute[75373]:     </rng>
Nov 29 07:24:37 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:24:37 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:24:37 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:24:37 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:37 user nova-compute[75373]:   </devices>
Nov 29 07:24:37 user nova-compute[75373]: </domain>
Nov 29 07:24:37 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1195464956',display_name='tempest-tempest.common.compute-instance-1195464956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1195464956',id=16,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRsyHbG85w5HbekWqoBkp9Q3xxhdnfF9fbtrQ2lHMPLX3XKgW+qiLfO8CukIk9RO9oEjdOjWIiDWegj2ermUs3oLFNXiCJogCzxUmEkjsZuW1o4Vk5MNAGNdNONe0aslg==',key_name='tempest-keypair-1354867634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-q8n3hu8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=7e23b02c-d997-46bc-b785-51fb6ce167ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_vif [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33b33016-7eee-53da-9a7b-2b709e66f2ad', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69034705-57, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69034705-57, col_values=(('qos', UUID('bcae7762-8f7d-40fa-879d-e1121fd28187')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69034705-57, col_values=(('external_ids', {'iface-id': '69034705-573c-4d5e-8ba1-db0cab8e23c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:24:b4', 'vm-uuid': '7e23b02c-d997-46bc-b785-51fb6ce167ee'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:37 user nova-compute[75373]: INFO os_vif [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57')
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No VIF found with MAC fa:16:3e:63:24:b4, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLAOGCbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:37 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:37 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:37 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:24:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb9c65-b683-4606-bcdc-a53418f449eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:24:38 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8baff7b-f3e3-4111-b9c0-0005bc4e2f88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168] added
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[128ce118-36f0-43fe-91a3-372e10f67f47]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5dc9b4-bbe1-4df6-a1fa-4e5f4c4f370c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLAOGCbx {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLAOGCbx" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2ac1c-2ce6-4a09-a621-3ea2c846d3e9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLAOGCbx'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6e56c-ee26-4d8f-a5e7-4305e28a0bfa]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updated VIF entry in instance network info cache for port 69034705-573c-4d5e-8ba1-db0cab8e23c4. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating instance_info_cache with network_info: [{"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964a277-5027-4ff5-aaae-081a968b0db4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe69ea6b-4047-4725-8d5c-588b007139e6 req-c1529190-9d59-4ac6-8e1a-da53c52da49a service nova] Releasing lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d90628-39c4-4598-843e-3473673671cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260]
Nov 29 07:24:38 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d27d9b-228e-40b4-a8ae-7a75aa042405]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[384e4467-4921-4241-9a21-45bfae9a353b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:38 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:38 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a67bc7-5388-4872-9eca-73451e338462]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:38 user nova-compute[75373]: INFO nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Booting with volume d3520029-94a3-4882-8fb4-f8186f97d7b2 at /dev/vdc
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d557ac33-abfe-4a64-8ad2-fac7125db739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a894cca-2df7-4a11-88d9-c5ed61a0d20b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9ff2a-f40d-4425-823d-fc60fd5fe0c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5f1a3-c069-48af-8168-cbcc0a165cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:24:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:24:39 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd14e42-6829-43fa-bc74-73e38f942f7b]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.utils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating existing volume attachment record: e705cbe3-b6e9-4b92-97e8-60ec7bd4598b {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] No waiting events found dispatching network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:39 user nova-compute[75373]: WARNING nova.compute.manager [req-2851447e-3e33-4069-ad9b-aba78f534635 req-1ba944e9-87bb-4bf6-9b8e-bc25cdbca49e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received unexpected event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 for instance with vm_state building and task_state spawning.
Nov 29 07:24:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLAOGCbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23431363033393739', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431363033393739', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:24:39 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:39 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:24:39 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:24:39 user nova-compute[75373]:   <serial>573f7800-8f59-48ef-b683-980b00b1d168</serial>
Nov 29 07:24:39 user nova-compute[75373]: </disk>
Nov 29 07:24:39 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] No VIF found with MAC fa:16:3e:2b:c0:0d, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6a49cfe5-a624-4bce-9b55-03f5281d1659 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.066s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:40 user nova-compute[75373]: INFO nova.compute.manager [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Terminating instance
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-unplugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] No waiting events found dispatching network-vif-unplugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d013ecc-a199-4baa-929e-686abd7a9400 req-f7610517-1a7c-4ab5-a5b9-9af3cbe34687 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-unplugged-267199ca-0c64-4c5e-855c-538cb80aeba8 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:24:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Instance destroyed successfully.
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lazy-loading 'resources' on Instance uuid 9eeeba70-7aba-4471-8bd8-6710fc3f5c17 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1021309039',display_name='tempest-TestVolumeSwap-server-1021309039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1021309039',id=9,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCyv4lrIrWMhWwPyOkIxueUHQdDzwrhAxTXIkMexKzGQQECDEvr9CAe1a3e1IwwganqYTOzabfsDXew3AJNX1zi8tT/Qv3xAJx4XsyanEaIMjP9tZF7Nwp3FIvBhve8wg==',key_name='tempest-keypair-2106273125',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd073ebee56448bfa0ba92d9f0788ab9',ramdisk_id='',reservation_id='r-63gphlob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1865011421',owner_user_name='tempest-TestVolumeSwap-1865011421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b85936f1d9142fd98ae1dde5de52c7e',uuid=9eeeba70-7aba-4471-8bd8-6710fc3f5c17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converting VIF {"id": "267199ca-0c64-4c5e-855c-538cb80aeba8", "address": "fa:16:3e:cf:7e:47", "network": {"id": "0b34f97e-aa15-4c79-8595-ffe0f697eeb2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1159073830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd073ebee56448bfa0ba92d9f0788ab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267199ca-0c", "ovs_interfaceid": "267199ca-0c64-4c5e-855c-538cb80aeba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG os_vif [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267199ca-0c, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfeccf37-ec66-490e-b6b0-c8682932245e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:40 user nova-compute[75373]: INFO os_vif [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7e:47,bridge_name='br-int',has_traffic_filtering=True,id=267199ca-0c64-4c5e-855c-538cb80aeba8,network=Network(0b34f97e-aa15-4c79-8595-ffe0f697eeb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267199ca-0c')
Nov 29 07:24:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Deleting instance files /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17_del
Nov 29 07:24:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Deletion of /opt/stack/data/nova/instances/9eeeba70-7aba-4471-8bd8-6710fc3f5c17_del complete
Nov 29 07:24:40 user nova-compute[75373]: INFO nova.compute.manager [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 07:24:40 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:24:40 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:41 user nova-compute[75373]: INFO nova.compute.manager [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Detaching volume 573f7800-8f59-48ef-b683-980b00b1d168
Nov 29 07:24:41 user nova-compute[75373]: INFO nova.virt.block_device [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attempting to driver detach volume 573f7800-8f59-48ef-b683-980b00b1d168 from mountpoint /dev/vdc
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Attempting to detach device vdc from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:24:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:41 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:24:41 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:24:41 user nova-compute[75373]:   <serial>573f7800-8f59-48ef-b683-980b00b1d168</serial>
Nov 29 07:24:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:24:41 user nova-compute[75373]: </disk>
Nov 29 07:24:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:24:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully detached device vdc from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the persistent domain config.
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:24:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:41 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:24:41 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:24:41 user nova-compute[75373]:   <serial>573f7800-8f59-48ef-b683-980b00b1d168</serial>
Nov 29 07:24:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:24:41 user nova-compute[75373]: </disk>
Nov 29 07:24:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] No waiting events found dispatching network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:41 user nova-compute[75373]: WARNING nova.compute.manager [req-80732098-0f18-417f-ad24-6a981ce26ca8 req-eef0a040-a82b-47a6-a6d9-fd8a6114d30a service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received unexpected event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 for instance with vm_state building and task_state spawning.
Nov 29 07:24:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:24:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Instance spawned successfully.
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:24:42 user nova-compute[75373]: INFO nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] Acquiring lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] No waiting events found dispatching network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:42 user nova-compute[75373]: WARNING nova.compute.manager [req-84717361-6f58-4034-b656-6e6502ade47c req-0e9579dc-e4a0-4c31-b986-1386b58a4b1d service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received unexpected event network-vif-plugged-267199ca-0c64-4c5e-855c-538cb80aeba8 for instance with vm_state active and task_state deleting.
Nov 29 07:24:42 user nova-compute[75373]: INFO nova.compute.manager [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Took 8.69 seconds to build instance.
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e8687d19-68a6-4c6f-9616-7fe96dafc37f tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.820s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:42 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Took 1.74 seconds to deallocate network for instance.
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:43 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:43 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:43 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Deleted allocations for instance 9eeeba70-7aba-4471-8bd8-6710fc3f5c17
Nov 29 07:24:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-072d0465-eb31-45ae-bebf-40e5c4117955 tempest-TestVolumeSwap-1865011421 tempest-TestVolumeSwap-1865011421-project-member] Lock "9eeeba70-7aba-4471-8bd8-6710fc3f5c17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.195s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-e327640f-929e-4502-92ff-47ed951eb028 req-3a47b3fa-08c7-40f9-b04f-2e9d016651c5 service nova] [instance: 9eeeba70-7aba-4471-8bd8-6710fc3f5c17] Received event network-vif-deleted-267199ca-0c64-4c5e-855c-538cb80aeba8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:24:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Creating image(s)
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Ensure instance console log exists: /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Start _get_guest_xml network_info=[{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPazMSBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '575318f4-4431-4e30-a1a2-d3f6fb6683fd', 'attached_at': '', 'detached_at': '', 'volume_id': '47080dae-d789-444a-8c83-79565c738f26', 'serial': '47080dae-d789-444a-8c83-79565c738f26'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '7591878f-d34b-4430-a70f-500dc3b32a26', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLcJZfFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '575318f4-4431-4e30-a1a2-d3f6fb6683fd', 'attached_at': '', 'detached_at': '', 'volume_id': '1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 'serial': '1c138c9e-e639-4adf-aeb3-fb72ff8ec83f'}, 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '138fd2bc-e5c5-4cc4-98f3-26d43763ade7', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buFSMHBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '575318f4-4431-4e30-a1a2-d3f6fb6683fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3520029-94a3-4882-8fb4-f8186f97d7b2', 'serial': 'd3520029-94a3-4882-8fb4-f8186f97d7b2'}, 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'e705cbe3-b6e9-4b92-97e8-60ec7bd4598b', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:24:47 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:47 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPazMSBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:47 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:47 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:47 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1743dc-b949-4cfd-a3f4-71fb243168a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:24:47 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbddf74-b595-4214-8b59-aa92b09e7183]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26] added
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7910fdac-077c-406c-8cab-f87c5d936d92]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e98d6-ab6e-4082-8610-a9747c4d80bb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPazMSBX {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPazMSBX" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2246c03-4ff8-4f1a-a7b1-6fa3209fbbdb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPazMSBX'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca85c43-d43e-411e-9d66-357695304cf5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9b7c6-b9bd-4fe9-88c4-028bf8417a46]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a8e76-b79e-48a3-84fe-57c6e65f98ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260]
Nov 29 07:24:47 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[61577d47-5c69-4537-99f8-8e8d1f362c61]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a367227-9c6f-4b2e-96be-8aae349eb471]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:47 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092aad1-06bf-413e-8ee3-b14deb6f57a7]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:47 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPazMSBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23465353365643235', 'path': '/dev/sdd'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465353365643235', 'path': '/dev/sdd'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLcJZfFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:48 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:24:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6bd10-1e6e-4514-bc49-2dec8c837de1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:24:49 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43288d3-94fa-421f-b82d-c9884bfa9a66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f] added
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45264d-2edb-473c-b26f-45f660e8652b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87a81ed-6672-4941-8bf6-f5d38b252c55]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLcJZfFw {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLcJZfFw" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6657e63a-d624-49fe-8f78-ca5f458889ef]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLcJZfFw'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc05208-bfee-4a44-8f2e-2adde45fe2a9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8245ec4-6a93-415b-8c8d-832d1f7c0878]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92490a9-ad47-4ba8-8073-6830eaa4e14e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260]
Nov 29 07:24:49 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b0f26-44df-4a58-b354-ef0cfa1d761d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f5a3b-10bc-42d4-9b13-48051fecfa9f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:49 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0cccac-9107-4504-89d1-518e780cccb5]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLcJZfFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23666643865363031', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666643865363031', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buFSMHBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:24:50 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:50 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:24:50 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bd08b-fba5-4336-8ba2-e330f6330f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:24:50 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be60c1-ee31-4117-8efb-e1b560d5fd56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2] added
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1c2d6-36ee-40bc-9d1a-b86f4190cfa0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8083b62-8f4a-491a-9a16-42d8608df99b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buFSMHBK {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buFSMHBK" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[700a94ba-5c4f-4cfc-8e40-c1c3c35ef9a1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buFSMHBK'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[837cf2b9-9977-430a-a219-4fc74654eb2b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e128566-9da5-42d4-b0c0-389878214f65]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd743fa-8472-403b-ad08-fd943540d73f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260]
Nov 29 07:24:50 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260] successful.
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb0846-860f-4227-abcb-e655481a3cc8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[474be161-c36c-4507-aea4-6ec4c269d476]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:24:50 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:24:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0000503-4de7-44f9-a84e-cd7c481b8948]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:24:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buFSMHBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=25.508712768554688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 43152b31-de51-4a18-8f6a-dd1617147fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 575318f4-4431-4e30-a1a2-d3f6fb6683fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23861303731393265', 'path': '/dev/sdf'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861303731393265', 'path': '/dev/sdf'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lazy-loading 'pci_devices' on Instance uuid 575318f4-4431-4e30-a1a2-d3f6fb6683fd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:24:51 user nova-compute[75373]:   <uuid>575318f4-4431-4e30-a1a2-d3f6fb6683fd</uuid>
Nov 29 07:24:51 user nova-compute[75373]:   <name>instance-0000000f</name>
Nov 29 07:24:51 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:24:51 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:24:51 user nova-compute[75373]:   <metadata>
Nov 29 07:24:51 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:51 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:name>tempest-device-tagging-server-1163869178</nova:name>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:24:47</nova:creationTime>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:24:51 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:51 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:owner>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:user uuid="f41fb36b68d94cef8551b930eed284d5">tempest-TaggedBootDevicesTest-1391239922-project-member</nova:user>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:project uuid="e8b2a7d8ed704aeaabb2d865f78704d3">tempest-TaggedBootDevicesTest-1391239922</nova:project>
Nov 29 07:24:51 user nova-compute[75373]:       </nova:owner>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:51 user nova-compute[75373]:       <nova:ports>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="7a84e996-fae2-4711-a6bb-80ca3fd97842">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="c2705e34-182d-4ae7-b800-9c9912042fe8">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="c93148e8-f2a6-4191-8c81-f2ff29f44cde">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="9159dced-a86c-4765-b9e3-f56b4b8fed6e">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="e1a4e104-89bb-4e60-aafb-57f204444966">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:         <nova:port uuid="5cc47e13-b920-426a-9ffe-c000c6678b7d">
Nov 29 07:24:51 user nova-compute[75373]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 07:24:51 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:51 user nova-compute[75373]:       </nova:ports>
Nov 29 07:24:51 user nova-compute[75373]:     </nova:instance>
Nov 29 07:24:51 user nova-compute[75373]:   </metadata>
Nov 29 07:24:51 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:24:51 user nova-compute[75373]:     <system>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="serial">575318f4-4431-4e30-a1a2-d3f6fb6683fd</entry>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="uuid">575318f4-4431-4e30-a1a2-d3f6fb6683fd</entry>
Nov 29 07:24:51 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:24:51 user nova-compute[75373]:     </system>
Nov 29 07:24:51 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:51 user nova-compute[75373]:   <os>
Nov 29 07:24:51 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:24:51 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:24:51 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:24:51 user nova-compute[75373]:   </os>
Nov 29 07:24:51 user nova-compute[75373]:   <features>
Nov 29 07:24:51 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:51 user nova-compute[75373]:     <apic/>
Nov 29 07:24:51 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:24:51 user nova-compute[75373]:   </features>
Nov 29 07:24:51 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:24:51 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:24:51 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:24:51 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:24:51 user nova-compute[75373]:   </clock>
Nov 29 07:24:51 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:24:51 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:24:51 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:24:51 user nova-compute[75373]:   </cpu>
Nov 29 07:24:51 user nova-compute[75373]:   <devices>
Nov 29 07:24:51 user nova-compute[75373]:     <disk type="file" device="cdrom">
Nov 29 07:24:51 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 07:24:51 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/disk.config"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="hda" bus="ide"/>
Nov 29 07:24:51 user nova-compute[75373]:     </disk>
Nov 29 07:24:51 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:24:51 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:51 user nova-compute[75373]:       <source dev="/dev/sdd"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <serial>47080dae-d789-444a-8c83-79565c738f26</serial>
Nov 29 07:24:51 user nova-compute[75373]:     </disk>
Nov 29 07:24:51 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:24:51 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:51 user nova-compute[75373]:       <source dev="/dev/sde"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <serial>1c138c9e-e639-4adf-aeb3-fb72ff8ec83f</serial>
Nov 29 07:24:51 user nova-compute[75373]:     </disk>
Nov 29 07:24:51 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:24:51 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:24:51 user nova-compute[75373]:       <source dev="/dev/sdf"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="vdc" bus="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <serial>d3520029-94a3-4882-8fb4-f8186f97d7b2</serial>
Nov 29 07:24:51 user nova-compute[75373]:     </disk>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:09:19:28"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tap7a84e996-fa"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:d0:e6:74"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tape24c2d40-36"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:e4:46:0d"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tapc2705e34-18"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:38:43:5b"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tapc93148e8-f2"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:92:c4:66"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tap9159dced-a8"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:ff:d9:e9"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tape1a4e104-89"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:51 user nova-compute[75373]:       <mac address="fa:16:3e:8a:44:87"/>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:51 user nova-compute[75373]:       <target dev="tap5cc47e13-b9"/>
Nov 29 07:24:51 user nova-compute[75373]:     </interface>
Nov 29 07:24:51 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:24:51 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/console.log" append="off"/>
Nov 29 07:24:51 user nova-compute[75373]:     </serial>
Nov 29 07:24:51 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:24:51 user nova-compute[75373]:     <video>
Nov 29 07:24:51 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:51 user nova-compute[75373]:     </video>
Nov 29 07:24:51 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:24:51 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:24:51 user nova-compute[75373]:     </rng>
Nov 29 07:24:51 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:24:51 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:24:51 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:24:51 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:51 user nova-compute[75373]:   </devices>
Nov 29 07:24:51 user nova-compute[75373]: </domain>
Nov 29 07:24:51 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5444955e-3688-5a27-9ea5-a1f617fbe4fa', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a84e996-fa, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a84e996-fa, col_values=(('qos', UUID('da35de2f-2dd3-40e4-88bd-5003298b9eac')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a84e996-fa, col_values=(('external_ids', {'iface-id': '7a84e996-fae2-4711-a6bb-80ca3fd97842', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:19:28', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa')
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1573c41-3575-5082-9875-08e8ded68094', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape24c2d40-36, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape24c2d40-36, col_values=(('qos', UUID('5832e0d7-f04e-4e14-b333-b2705dd15fe7')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape24c2d40-36, col_values=(('external_ids', {'iface-id': 'e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:e6:74', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36')
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abe32141-2f58-54c3-9997-4f8011ec593e', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2705e34-18, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2705e34-18, col_values=(('qos', UUID('e5f27b08-b4d8-4afe-a4f2-09d4205ef53f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2705e34-18, col_values=(('external_ids', {'iface-id': 'c2705e34-182d-4ae7-b800-9c9912042fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:46:0d', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18')
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '245d825b-2678-556a-b0b0-8559aa6f125c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93148e8-f2, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc93148e8-f2, col_values=(('qos', UUID('dbdea8fa-71ea-448b-9803-ca84be3e8081')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc93148e8-f2, col_values=(('external_ids', {'iface-id': 'c93148e8-f2a6-4191-8c81-f2ff29f44cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:43:5b', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2')
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eae4cfe-b84a-52ac-8b30-47759c538a32', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9159dced-a8, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9159dced-a8, col_values=(('qos', UUID('780dfb8f-a8a9-49fa-a5d4-91f9e5c4ddfb')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9159dced-a8, col_values=(('external_ids', {'iface-id': '9159dced-a86c-4765-b9e3-f56b4b8fed6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c4:66', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:24:52 user nova-compute[75373]: INFO nova.compute.claims [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Claim successful on node user
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8')
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb3d61ce-140d-5fb0-971e-bf4a7986ccd9', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a4e104-89, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1a4e104-89, col_values=(('qos', UUID('8157e2c2-4d80-4dc9-a8fc-cb79169e9239')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1a4e104-89, col_values=(('external_ids', {'iface-id': 'e1a4e104-89bb-4e60-aafb-57f204444966', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:d9:e9', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89')
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33088379-2675-525b-bb59-33f476080876', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc47e13-b9, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc47e13-b9, col_values=(('qos', UUID('558b2f59-9881-4a60-be1e-e3ae70dfbacd')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc47e13-b9, col_values=(('external_ids', {'iface-id': '5cc47e13-b920-426a-9ffe-c000c6678b7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:44:87', 'vm-uuid': '575318f4-4431-4e30-a1a2-d3f6fb6683fd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:52 user nova-compute[75373]: INFO os_vif [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9')
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] No BDM found with device name hda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] No VIF found with MAC fa:16:3e:09:19:28, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] No VIF found with MAC fa:16:3e:92:c4:66, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Using config drive
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:24:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:24:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Creating config drive at /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/disk.config
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk85xfzcn {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk85xfzcn" returned: 0 in 0.059s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.policy [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7dec6d7789c4430ad19e175de4b3519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff517549ee99421aa0e9d570d4fb6941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:24:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Creating image(s)
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk 1073741824" returned: 0 in 0.047s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Successfully created port: e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Cannot resize image /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Ensure instance console log exists: /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:54 user nova-compute[75373]: WARNING nova.compute.manager [req-78933f59-6128-49b4-9f17-a3ff3fa24a78 req-ca74d22a-593f-43f2-afdc-a9506273b6f7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 for instance with vm_state building and task_state spawning.
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Successfully updated port: e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-changed-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Refreshing instance network info cache due to event network-changed-e063aa71-dd31-4af0-9d79-10dcd9c036d0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] Acquiring lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Instance network_info: |[{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] Acquired lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Refreshing network info cache for port e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Start _get_guest_xml network_info=[{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-245583955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-245583955',id=17,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-kktjl5mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:53Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=7c25504f-ed6b-409c-8849-68c1ca27fe93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.objects.instance [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c25504f-ed6b-409c-8849-68c1ca27fe93 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:24:55 user nova-compute[75373]:   <uuid>7c25504f-ed6b-409c-8849-68c1ca27fe93</uuid>
Nov 29 07:24:55 user nova-compute[75373]:   <name>instance-00000011</name>
Nov 29 07:24:55 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:24:55 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:24:55 user nova-compute[75373]:   <metadata>
Nov 29 07:24:55 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:24:55 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-245583955</nova:name>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:24:55</nova:creationTime>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:24:55 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:24:55 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:owner>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:24:55 user nova-compute[75373]:       </nova:owner>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:24:55 user nova-compute[75373]:       <nova:ports>
Nov 29 07:24:55 user nova-compute[75373]:         <nova:port uuid="e063aa71-dd31-4af0-9d79-10dcd9c036d0">
Nov 29 07:24:55 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:24:55 user nova-compute[75373]:         </nova:port>
Nov 29 07:24:55 user nova-compute[75373]:       </nova:ports>
Nov 29 07:24:55 user nova-compute[75373]:     </nova:instance>
Nov 29 07:24:55 user nova-compute[75373]:   </metadata>
Nov 29 07:24:55 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:24:55 user nova-compute[75373]:     <system>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="serial">7c25504f-ed6b-409c-8849-68c1ca27fe93</entry>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="uuid">7c25504f-ed6b-409c-8849-68c1ca27fe93</entry>
Nov 29 07:24:55 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:24:55 user nova-compute[75373]:     </system>
Nov 29 07:24:55 user nova-compute[75373]:   </sysinfo>
Nov 29 07:24:55 user nova-compute[75373]:   <os>
Nov 29 07:24:55 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:24:55 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:24:55 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:24:55 user nova-compute[75373]:   </os>
Nov 29 07:24:55 user nova-compute[75373]:   <features>
Nov 29 07:24:55 user nova-compute[75373]:     <acpi/>
Nov 29 07:24:55 user nova-compute[75373]:     <apic/>
Nov 29 07:24:55 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:24:55 user nova-compute[75373]:   </features>
Nov 29 07:24:55 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:24:55 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:24:55 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:24:55 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:24:55 user nova-compute[75373]:   </clock>
Nov 29 07:24:55 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:24:55 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:24:55 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:24:55 user nova-compute[75373]:   </cpu>
Nov 29 07:24:55 user nova-compute[75373]:   <devices>
Nov 29 07:24:55 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:24:55 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:24:55 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk"/>
Nov 29 07:24:55 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:24:55 user nova-compute[75373]:     </disk>
Nov 29 07:24:55 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:24:55 user nova-compute[75373]:       <mac address="fa:16:3e:d9:c1:52"/>
Nov 29 07:24:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:55 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:24:55 user nova-compute[75373]:       <target dev="tape063aa71-dd"/>
Nov 29 07:24:55 user nova-compute[75373]:     </interface>
Nov 29 07:24:55 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:24:55 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/console.log" append="off"/>
Nov 29 07:24:55 user nova-compute[75373]:     </serial>
Nov 29 07:24:55 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:24:55 user nova-compute[75373]:     <video>
Nov 29 07:24:55 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:24:55 user nova-compute[75373]:     </video>
Nov 29 07:24:55 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:24:55 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:24:55 user nova-compute[75373]:     </rng>
Nov 29 07:24:55 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:24:55 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:24:55 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:24:55 user nova-compute[75373]:     </memballoon>
Nov 29 07:24:55 user nova-compute[75373]:   </devices>
Nov 29 07:24:55 user nova-compute[75373]: </domain>
Nov 29 07:24:55 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-245583955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-245583955',id=17,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-kktjl5mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:24:53Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=7c25504f-ed6b-409c-8849-68c1ca27fe93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG os_vif [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43cc21fd-02b0-59bd-9e3a-384a34cf2864', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape063aa71-dd, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape063aa71-dd, col_values=(('qos', UUID('b575df7d-e05a-41f0-9439-e599cc0d00f2')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape063aa71-dd, col_values=(('external_ids', {'iface-id': 'e063aa71-dd31-4af0-9d79-10dcd9c036d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:c1:52', 'vm-uuid': '7c25504f-ed6b-409c-8849-68c1ca27fe93'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: INFO os_vif [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd')
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:d9:c1:52, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updated VIF entry in instance network info cache for port e063aa71-dd31-4af0-9d79-10dcd9c036d0. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03b8edf9-7f42-4ed6-b18d-4cf1374aa0b5 req-a2e11644-ed27-4049-9e14-6e0bd4e08aef service nova] Releasing lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-a6f9f5e9-1dcc-4e04-b51c-bc8627b5d8f1 req-1ee428e1-e448-454e-90de-91a3326dc50a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:56 user nova-compute[75373]: WARNING nova.compute.manager [req-1b4c53cf-af12-42e6-89f3-f4938416ba3d req-50601c1c-891d-45e6-b06e-02e7fb2066af service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 for instance with vm_state building and task_state spawning.
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:57 user nova-compute[75373]: WARNING nova.compute.manager [req-1434b006-f94b-4c22-bb96-32384529059c req-31b23e58-50b0-40df-ab3e-e695b3e91733 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c for instance with vm_state building and task_state spawning.
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] No waiting events found dispatching network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:58 user nova-compute[75373]: WARNING nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received unexpected event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 for instance with vm_state building and task_state spawning.
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] No waiting events found dispatching network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:58 user nova-compute[75373]: WARNING nova.compute.manager [req-6f46cffe-6ead-47f8-b794-62372a9df12a req-ec9035e2-3665-414d-9a05-1785d2aaf538 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received unexpected event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 for instance with vm_state building and task_state spawning.
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:58 user nova-compute[75373]: WARNING nova.compute.manager [req-a0fa2416-1844-4356-a63b-6174c3f09c45 req-ea20a44e-bf8e-400f-938f-583ec40ccfed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 for instance with vm_state building and task_state spawning.
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:59 user nova-compute[75373]: WARNING nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c for instance with vm_state building and task_state spawning.
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:59 user nova-compute[75373]: WARNING nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d for instance with vm_state building and task_state spawning.
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:24:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:24:59 user nova-compute[75373]: WARNING nova.compute.manager [req-b48d1101-b79b-43e4-82ed-8ffdb338ea7a req-6efd1559-6615-4fd8-9356-0718e8d376a7 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d for instance with vm_state building and task_state spawning.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance spawned successfully.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Instance spawned successfully.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Took 12.70 seconds to spawn the instance on the hypervisor.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.compute.manager [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Took 40.70 seconds to build instance.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b244a85b-b877-45af-a89a-892ae3bdb12a tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.830s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:00 user nova-compute[75373]: INFO nova.compute.manager [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Took 8.19 seconds to build instance.
Nov 29 07:25:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-413d78c8-ac2a-4d6f-a678-b0927786b92d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.321s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc is timed out.
Nov 29 07:25:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully detached device vdc from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the live domain config.
Nov 29 07:25:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLAOGCbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:25:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f72176-832f-4f8f-b842-f00c5eb66332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:25:01 user nova-compute[75373]: No targets found.
Nov 29 07:25:01 user nova-compute[75373]: iSNS:
Nov 29 07:25:01 user nova-compute[75373]: No targets found.
Nov 29 07:25:01 user nova-compute[75373]: STATIC:
Nov 29 07:25:01 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26
Nov 29 07:25:01 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:01 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:01 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f
Nov 29 07:25:01 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:01 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:01 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2
Nov 29 07:25:01 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:01 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:01 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b
Nov 29 07:25:01 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:01 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:01 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168
Nov 29 07:25:01 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:01 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:01 user nova-compute[75373]: FIRMWARE:
Nov 29 07:25:01 user nova-compute[75373]: No targets found.
Nov 29 07:25:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:25:01 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:25:01 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67751bb-3bc9-4cfe-bf21-86ba39929361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25e5c9c-846d-43f4-9dca-3b3e12f74d7e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:25:01 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:25:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08933250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f4955-5feb-44da-91fd-e2a2c1434791]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1272d40-37cf-4ac2-903f-60cafaca4e9a]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:25:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[266ae93d-525e-4978-b052-3893111f87b1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8021bec8-fbe5-424a-93f9-ddfb085e084e]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9a62b-6038-428b-9a89-da5760e3def1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe8b01b-a6f1-4096-bd5c-65613e8c392f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260]
Nov 29 07:25:02 user nova-compute[75373]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168, portal: 172.16.0.220,3260] successful.
Nov 29 07:25:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:573f7800-8f59-48ef-b683-980b00b1d168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1b4fc-3b2d-4b09-b8e4-6dee05e982e7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== disconnect_volume: return (402ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:25:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:25:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21e7de64-f9bd-4a1a-8dde-df2c2b92c7ff tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.173s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:25:13 user nova-compute[75373]: INFO nova.compute.claims [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Claim successful on node user
Nov 29 07:25:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:25:14 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.policy [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f571f40d066b4d198fcf6d49c22ad1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249771bcbe724be3ac7c15231dd07e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:25:14 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Creating image(s)
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk 1073741824" returned: 0 in 0.065s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Successfully created port: 825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Ensure instance console log exists: /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Successfully updated port: 825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-changed-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Refreshing instance network info cache due to event network-changed-825d3fb3-d49c-4814-82e1-30be81642c31. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance network_info: |[{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Refreshing network info cache for port 825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start _get_guest_xml network_info=[{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:25:16 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:16 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:25:16 user nova-compute[75373]:   <uuid>5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</uuid>
Nov 29 07:25:16 user nova-compute[75373]:   <name>instance-00000012</name>
Nov 29 07:25:16 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:25:16 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:25:16 user nova-compute[75373]:   <metadata>
Nov 29 07:25:16 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:25:16 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeTestJSON-server-770343245</nova:name>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:25:16</nova:creationTime>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:25:16 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:25:16 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:owner>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:user uuid="f571f40d066b4d198fcf6d49c22ad1c1">tempest-AttachVolumeTestJSON-1182766882-project-member</nova:user>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:project uuid="249771bcbe724be3ac7c15231dd07e45">tempest-AttachVolumeTestJSON-1182766882</nova:project>
Nov 29 07:25:16 user nova-compute[75373]:       </nova:owner>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:25:16 user nova-compute[75373]:       <nova:ports>
Nov 29 07:25:16 user nova-compute[75373]:         <nova:port uuid="825d3fb3-d49c-4814-82e1-30be81642c31">
Nov 29 07:25:16 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:25:16 user nova-compute[75373]:         </nova:port>
Nov 29 07:25:16 user nova-compute[75373]:       </nova:ports>
Nov 29 07:25:16 user nova-compute[75373]:     </nova:instance>
Nov 29 07:25:16 user nova-compute[75373]:   </metadata>
Nov 29 07:25:16 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:25:16 user nova-compute[75373]:     <system>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="serial">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="uuid">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:25:16 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:25:16 user nova-compute[75373]:     </system>
Nov 29 07:25:16 user nova-compute[75373]:   </sysinfo>
Nov 29 07:25:16 user nova-compute[75373]:   <os>
Nov 29 07:25:16 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:25:16 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:25:16 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:25:16 user nova-compute[75373]:   </os>
Nov 29 07:25:16 user nova-compute[75373]:   <features>
Nov 29 07:25:16 user nova-compute[75373]:     <acpi/>
Nov 29 07:25:16 user nova-compute[75373]:     <apic/>
Nov 29 07:25:16 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:25:16 user nova-compute[75373]:   </features>
Nov 29 07:25:16 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:25:16 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:25:16 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:25:16 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:25:16 user nova-compute[75373]:   </clock>
Nov 29 07:25:16 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:25:16 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:25:16 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:25:16 user nova-compute[75373]:   </cpu>
Nov 29 07:25:16 user nova-compute[75373]:   <devices>
Nov 29 07:25:16 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:25:16 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:25:16 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk"/>
Nov 29 07:25:16 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:25:16 user nova-compute[75373]:     </disk>
Nov 29 07:25:16 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:25:16 user nova-compute[75373]:       <mac address="fa:16:3e:c9:28:6e"/>
Nov 29 07:25:16 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:16 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:25:16 user nova-compute[75373]:       <target dev="tap825d3fb3-d4"/>
Nov 29 07:25:16 user nova-compute[75373]:     </interface>
Nov 29 07:25:16 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:25:16 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/console.log" append="off"/>
Nov 29 07:25:16 user nova-compute[75373]:     </serial>
Nov 29 07:25:16 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:25:16 user nova-compute[75373]:     <video>
Nov 29 07:25:16 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:16 user nova-compute[75373]:     </video>
Nov 29 07:25:16 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:25:16 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:25:16 user nova-compute[75373]:     </rng>
Nov 29 07:25:16 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:25:16 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:25:16 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:25:16 user nova-compute[75373]:     </memballoon>
Nov 29 07:25:16 user nova-compute[75373]:   </devices>
Nov 29 07:25:16 user nova-compute[75373]: </domain>
Nov 29 07:25:16 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG os_vif [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '475d8446-9b98-5d5e-8885-926c75a1355c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap825d3fb3-d4, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap825d3fb3-d4, col_values=(('qos', UUID('3f7e5745-f033-41ff-aabb-8be310516ad2')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap825d3fb3-d4, col_values=(('external_ids', {'iface-id': '825d3fb3-d49c-4814-82e1-30be81642c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:28:6e', 'vm-uuid': '5bfdfeb1-6da4-4f38-8c3d-ea1af1222680'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:16 user nova-compute[75373]: INFO os_vif [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No VIF found with MAC fa:16:3e:c9:28:6e, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updated VIF entry in instance network info cache for port 825d3fb3-d49c-4814-82e1-30be81642c31. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fb4d2447-6a7e-4b45-a32c-5b556486692c req-b8c2ffa8-5e8b-4bfa-bd61-662668ef01a4 service nova] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:18 user nova-compute[75373]: WARNING nova.compute.manager [req-c5c28029-f9b8-4f5d-951a-8d0f92effad3 req-771b0238-4fc5-4a93-a77b-ec8b9b3f18f6 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state building and task_state spawning.
Nov 29 07:25:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:25:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance spawned successfully.
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:20 user nova-compute[75373]: INFO nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:20 user nova-compute[75373]: WARNING nova.compute.manager [req-a1901317-a45f-43fd-8a1c-0b99267d9e29 req-8bbcd6b4-511d-470c-8bfb-cc600e403522 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state building and task_state spawning.
Nov 29 07:25:20 user nova-compute[75373]: INFO nova.compute.manager [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Took 6.85 seconds to build instance.
Nov 29 07:25:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2e9a5b67-c96b-4c58-a42d-f5fd23ada0a3 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.969s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:31 user nova-compute[75373]: INFO nova.compute.manager [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Rescuing
Nov 29 07:25:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:31 user nova-compute[75373]: DEBUG nova.network.neutron [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:25:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:32 user nova-compute[75373]: INFO nova.compute.manager [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Detaching volume 83e2f25a-96f2-404a-b023-ccaa9eb6ec1b
Nov 29 07:25:32 user nova-compute[75373]: INFO nova.virt.block_device [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Attempting to driver detach volume 83e2f25a-96f2-404a-b023-ccaa9eb6ec1b from mountpoint /dev/vdb
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Attempting to detach device vdb from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:25:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:25:32 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:25:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:25:32 user nova-compute[75373]:   <serial>83e2f25a-96f2-404a-b023-ccaa9eb6ec1b</serial>
Nov 29 07:25:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:25:32 user nova-compute[75373]: </disk>
Nov 29 07:25:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:25:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully detached device vdb from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the persistent domain config.
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:25:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:25:32 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:25:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:25:32 user nova-compute[75373]:   <serial>83e2f25a-96f2-404a-b023-ccaa9eb6ec1b</serial>
Nov 29 07:25:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:25:32 user nova-compute[75373]: </disk>
Nov 29 07:25:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.network.neutron [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:32 user nova-compute[75373]: WARNING nova.compute.manager [req-56c8ace6-6743-4052-8180-07fc440370d7 req-487d07f4-1238-4b9d-88f7-25c0e3886542 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state rescuing.
Nov 29 07:25:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance destroyed successfully.
Nov 29 07:25:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Attempting rescue
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:25:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Creating image(s)
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'trusted_certs' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue" returned: 0 in 0.071s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'migration_context' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.base [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<844be7c0-d83d-401f-9c62-bca197bf1683> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start _get_guest_xml network_info=[{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:a1:da:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.base [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<844be7c0-d83d-401f-9c62-bca197bf1683> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'numa_topology' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.base [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<844be7c0-d83d-401f-9c62-bca197bf1683> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:25:33 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:33 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'vcpu_model' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.base [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<844be7c0-d83d-401f-9c62-bca197bf1683> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-357729244',display_name='tempest-ServerRescueNegativeTestJSON-server-357729244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-357729244',id=3,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-3n8vngq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:21:05Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=844be7c0-d83d-401f-9c62-bca197bf1683,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:a1:da:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:a1:da:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.objects.base [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<844be7c0-d83d-401f-9c62-bca197bf1683> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:25:33 user nova-compute[75373]:   <uuid>844be7c0-d83d-401f-9c62-bca197bf1683</uuid>
Nov 29 07:25:33 user nova-compute[75373]:   <name>instance-00000003</name>
Nov 29 07:25:33 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:25:33 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:25:33 user nova-compute[75373]:   <metadata>
Nov 29 07:25:33 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:25:33 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-357729244</nova:name>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:25:33</nova:creationTime>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:25:33 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:25:33 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:owner>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:25:33 user nova-compute[75373]:       </nova:owner>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:25:33 user nova-compute[75373]:       <nova:ports>
Nov 29 07:25:33 user nova-compute[75373]:         <nova:port uuid="36fe1fea-00f2-41e9-9035-229c5d9222d6">
Nov 29 07:25:33 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:25:33 user nova-compute[75373]:         </nova:port>
Nov 29 07:25:33 user nova-compute[75373]:       </nova:ports>
Nov 29 07:25:33 user nova-compute[75373]:     </nova:instance>
Nov 29 07:25:33 user nova-compute[75373]:   </metadata>
Nov 29 07:25:33 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:25:33 user nova-compute[75373]:     <system>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="serial">844be7c0-d83d-401f-9c62-bca197bf1683</entry>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="uuid">844be7c0-d83d-401f-9c62-bca197bf1683</entry>
Nov 29 07:25:33 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:25:33 user nova-compute[75373]:     </system>
Nov 29 07:25:33 user nova-compute[75373]:   </sysinfo>
Nov 29 07:25:33 user nova-compute[75373]:   <os>
Nov 29 07:25:33 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:25:33 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:25:33 user nova-compute[75373]:   </os>
Nov 29 07:25:33 user nova-compute[75373]:   <features>
Nov 29 07:25:33 user nova-compute[75373]:     <acpi/>
Nov 29 07:25:33 user nova-compute[75373]:     <apic/>
Nov 29 07:25:33 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:25:33 user nova-compute[75373]:   </features>
Nov 29 07:25:33 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:25:33 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:25:33 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:25:33 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:25:33 user nova-compute[75373]:   </clock>
Nov 29 07:25:33 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:25:33 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:25:33 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:25:33 user nova-compute[75373]:   </cpu>
Nov 29 07:25:33 user nova-compute[75373]:   <devices>
Nov 29 07:25:33 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:25:33 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:25:33 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue"/>
Nov 29 07:25:33 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:25:33 user nova-compute[75373]:     </disk>
Nov 29 07:25:33 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:25:33 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:25:33 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk"/>
Nov 29 07:25:33 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:25:33 user nova-compute[75373]:     </disk>
Nov 29 07:25:33 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:25:33 user nova-compute[75373]:       <mac address="fa:16:3e:a1:da:97"/>
Nov 29 07:25:33 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:33 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:25:33 user nova-compute[75373]:       <target dev="tap36fe1fea-00"/>
Nov 29 07:25:33 user nova-compute[75373]:     </interface>
Nov 29 07:25:33 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:25:33 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/console.log" append="off"/>
Nov 29 07:25:33 user nova-compute[75373]:     </serial>
Nov 29 07:25:33 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:25:33 user nova-compute[75373]:     <video>
Nov 29 07:25:33 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:33 user nova-compute[75373]:     </video>
Nov 29 07:25:33 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:25:33 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:25:33 user nova-compute[75373]:     </rng>
Nov 29 07:25:33 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:25:33 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:25:33 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:25:33 user nova-compute[75373]:     </memballoon>
Nov 29 07:25:33 user nova-compute[75373]:   </devices>
Nov 29 07:25:33 user nova-compute[75373]: </domain>
Nov 29 07:25:33 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:25:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance destroyed successfully.
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:25:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:a1:da:97, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:25:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:34 user nova-compute[75373]: WARNING nova.compute.manager [req-b50285fe-e970-4504-b7c9-4cbc2ea217b7 req-732f7444-768c-4021-982d-47d4dc359115 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state rescuing.
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:36 user nova-compute[75373]: WARNING nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state rescuing.
Nov 29 07:25:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:36 user nova-compute[75373]: WARNING nova.compute.manager [req-88c89450-2790-43c6-bcfc-64aa9f68bcdd req-b8dde72e-601c-472a-9e0b-0a7cef5fadf1 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state active and task_state rescuing.
Nov 29 07:25:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-389e4189-0d49-4d1c-9ecd-9dd6355ec8c6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:25:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:25:48 user nova-compute[75373]: INFO nova.compute.claims [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Claim successful on node user
Nov 29 07:25:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:25:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:25:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Creating image(s)
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG nova.policy [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fa1e258308644589a58d3ba9b99d09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32b5fe43b84c2b9df54631c7a3edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.233s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk 1073741824" returned: 0 in 0.057s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.216s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Successfully created port: 43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Cannot resize image /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Ensure instance console log exists: /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Successfully updated port: 43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-changed-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Refreshing instance network info cache due to event network-changed-43faadde-ad57-4b96-913b-6f6c2aab789b. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] Acquiring lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] Acquired lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Refreshing network info cache for port 43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1360ef3-58b0-4200-8238-1ab0c6937f23 req-bd19cf25-ede7-468c-a705-c4f924ea1eb2 service nova] Releasing lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquired lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updating instance_info_cache with network_info: [{"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Releasing lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance network_info: |[{"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Start _get_guest_xml network_info=[{"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:25:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1601426277',display_name='tempest-AttachVolumeNegativeTest-server-1601426277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1601426277',id=19,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMGni62DAkP9wiOpXTWWw/BgREVPYe2+bZgkU9lBvQb0ETqN0XdtQwtk91bSvwJYoKPiIvJxejYr13kavJVpZ7WO1wsYJj/LJHYetG+TK6MMI9/r/Im1fw44kGjzFHY4g==',key_name='tempest-keypair-939757089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-vb5f0uoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=4f72ae79-e38e-4973-ae0c-60d4fcf78db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:25:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:25:52 user nova-compute[75373]:   <uuid>4f72ae79-e38e-4973-ae0c-60d4fcf78db4</uuid>
Nov 29 07:25:52 user nova-compute[75373]:   <name>instance-00000013</name>
Nov 29 07:25:52 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:25:52 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:25:52 user nova-compute[75373]:   <metadata>
Nov 29 07:25:52 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:25:52 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1601426277</nova:name>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:25:51</nova:creationTime>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:25:52 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:25:52 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:owner>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:user uuid="0fa1e258308644589a58d3ba9b99d09a">tempest-AttachVolumeNegativeTest-2030774109-project-member</nova:user>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:project uuid="fc32b5fe43b84c2b9df54631c7a3edb9">tempest-AttachVolumeNegativeTest-2030774109</nova:project>
Nov 29 07:25:52 user nova-compute[75373]:       </nova:owner>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:25:52 user nova-compute[75373]:       <nova:ports>
Nov 29 07:25:52 user nova-compute[75373]:         <nova:port uuid="43faadde-ad57-4b96-913b-6f6c2aab789b">
Nov 29 07:25:52 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:25:52 user nova-compute[75373]:         </nova:port>
Nov 29 07:25:52 user nova-compute[75373]:       </nova:ports>
Nov 29 07:25:52 user nova-compute[75373]:     </nova:instance>
Nov 29 07:25:52 user nova-compute[75373]:   </metadata>
Nov 29 07:25:52 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:25:52 user nova-compute[75373]:     <system>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="serial">4f72ae79-e38e-4973-ae0c-60d4fcf78db4</entry>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="uuid">4f72ae79-e38e-4973-ae0c-60d4fcf78db4</entry>
Nov 29 07:25:52 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:25:52 user nova-compute[75373]:     </system>
Nov 29 07:25:52 user nova-compute[75373]:   </sysinfo>
Nov 29 07:25:52 user nova-compute[75373]:   <os>
Nov 29 07:25:52 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:25:52 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:25:52 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:25:52 user nova-compute[75373]:   </os>
Nov 29 07:25:52 user nova-compute[75373]:   <features>
Nov 29 07:25:52 user nova-compute[75373]:     <acpi/>
Nov 29 07:25:52 user nova-compute[75373]:     <apic/>
Nov 29 07:25:52 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:25:52 user nova-compute[75373]:   </features>
Nov 29 07:25:52 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:25:52 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:25:52 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:25:52 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:25:52 user nova-compute[75373]:   </clock>
Nov 29 07:25:52 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:25:52 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:25:52 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:25:52 user nova-compute[75373]:   </cpu>
Nov 29 07:25:52 user nova-compute[75373]:   <devices>
Nov 29 07:25:52 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:25:52 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:25:52 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk"/>
Nov 29 07:25:52 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:25:52 user nova-compute[75373]:     </disk>
Nov 29 07:25:52 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:25:52 user nova-compute[75373]:       <mac address="fa:16:3e:00:2b:11"/>
Nov 29 07:25:52 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:52 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:25:52 user nova-compute[75373]:       <target dev="tap43faadde-ad"/>
Nov 29 07:25:52 user nova-compute[75373]:     </interface>
Nov 29 07:25:52 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:25:52 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/console.log" append="off"/>
Nov 29 07:25:52 user nova-compute[75373]:     </serial>
Nov 29 07:25:52 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:25:52 user nova-compute[75373]:     <video>
Nov 29 07:25:52 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:25:52 user nova-compute[75373]:     </video>
Nov 29 07:25:52 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:25:52 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:25:52 user nova-compute[75373]:     </rng>
Nov 29 07:25:52 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:25:52 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:25:52 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:25:52 user nova-compute[75373]:     </memballoon>
Nov 29 07:25:52 user nova-compute[75373]:   </devices>
Nov 29 07:25:52 user nova-compute[75373]: </domain>
Nov 29 07:25:52 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1601426277',display_name='tempest-AttachVolumeNegativeTest-server-1601426277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1601426277',id=19,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMGni62DAkP9wiOpXTWWw/BgREVPYe2+bZgkU9lBvQb0ETqN0XdtQwtk91bSvwJYoKPiIvJxejYr13kavJVpZ7WO1wsYJj/LJHYetG+TK6MMI9/r/Im1fw44kGjzFHY4g==',key_name='tempest-keypair-939757089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-vb5f0uoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=4f72ae79-e38e-4973-ae0c-60d4fcf78db4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG os_vif [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47b02c14-0b83-561b-b86d-18a6f4ef8090', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43faadde-ad, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43faadde-ad, col_values=(('qos', UUID('6fe6f246-b70f-455c-8741-00eff0549c16')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43faadde-ad, col_values=(('external_ids', {'iface-id': '43faadde-ad57-4b96-913b-6f6c2aab789b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:2b:11', 'vm-uuid': '4f72ae79-e38e-4973-ae0c-60d4fcf78db4'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:52 user nova-compute[75373]: INFO os_vif [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad')
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:00:2b:11, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:25:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc is timed out.
Nov 29 07:25:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully detached device vdb from instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc from the live domain config.
Nov 29 07:25:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLCogyte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:25:52 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:25:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:25:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6689af-896c-4762-88af-c32d067b029a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:25:53 user nova-compute[75373]: No targets found.
Nov 29 07:25:53 user nova-compute[75373]: iSNS:
Nov 29 07:25:53 user nova-compute[75373]: No targets found.
Nov 29 07:25:53 user nova-compute[75373]: STATIC:
Nov 29 07:25:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26
Nov 29 07:25:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f
Nov 29 07:25:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2
Nov 29 07:25:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b
Nov 29 07:25:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:25:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:25:53 user nova-compute[75373]: FIRMWARE:
Nov 29 07:25:53 user nova-compute[75373]: No targets found.
Nov 29 07:25:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:25:53 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:25:53 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d380617-679b-4d62-af42-452e4ac4b8aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81845d-c2d2-4cfb-9e09-12d1927129b0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:25:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:25:53 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:25:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0493130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03945dd7-4eb7-411f-9f1e-11347b8b7b11]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca95caf7-0be1-456b-b312-676c1f8269ed]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f77510-2f50-4ad0-9226-f02555bde348]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2bc54-e38b-405c-affa-65e1207fa2cd]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bb604b-4be3-4a74-b269-a511e5fde358]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[836e06bd-b26f-482e-97d6-d6f4b2e0fe74]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260]
Nov 29 07:25:53 user nova-compute[75373]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b, portal: 172.16.0.220,3260] successful.
Nov 29 07:25:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e2f25a-96f2-404a-b023-ccaa9eb6ec1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[305867e6-9e4b-4f9c-9e96-b9cca7eb98f0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] <== disconnect_volume: return (437ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] No waiting events found dispatching network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:54 user nova-compute[75373]: WARNING nova.compute.manager [req-96bccd55-1286-4b0c-b48b-75a0ce7129ac req-bafccecf-0123-4fd1-8188-42f545fca531 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received unexpected event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b for instance with vm_state building and task_state spawning.
Nov 29 07:25:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'flavor' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-530e37e4-26a9-4217-bdb7-93d2fe3561fb tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.371s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:25:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance spawned successfully.
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] No waiting events found dispatching network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:25:56 user nova-compute[75373]: WARNING nova.compute.manager [req-afcc08fe-85c6-4918-b47e-b826bda79e46 req-4c87cc83-a484-47f3-9a11-7ae02c387d69 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received unexpected event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b for instance with vm_state building and task_state spawning.
Nov 29 07:25:56 user nova-compute[75373]: INFO nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 29 07:25:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:56 user nova-compute[75373]: INFO nova.compute.manager [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Took 7.82 seconds to build instance.
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a75a98a4-cf4a-4498-99c3-6762ec4cdf11 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.992s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:25:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:00 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:00 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7201MB free_disk=25.406681060791016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 43152b31-de51-4a18-8f6a-dd1617147fd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 575318f4-4431-4e30-a1a2-d3f6fb6683fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:26:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:26:01 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:01 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:01 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:26:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.compute.claims [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Claim successful on node user
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.compute.manager [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Terminating instance
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.policy [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d67f374467c43e1b247a4fbc69e67d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb2c66f2ee4df08d54238965f90bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Instance destroyed successfully.
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'resources' on Instance uuid 43152b31-de51-4a18-8f6a-dd1617147fd8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1976443111',display_name='tempest-VolumesAdminNegativeTest-server-1976443111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1976443111',id=14,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-eidtagkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:24:11Z,user_data=None,user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=43152b31-de51-4a18-8f6a-dd1617147fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "address": "fa:16:3e:e8:55:48", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f77f422-f7", "ovs_interfaceid": "6f77f422-f7de-4e45-9c32-4659d9c6cdcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG os_vif [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f77f422-f7, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac7689a9-f839-4f74-b759-5b8a2e1af8fa) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:03 user nova-compute[75373]: INFO os_vif [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:55:48,bridge_name='br-int',has_traffic_filtering=True,id=6f77f422-f7de-4e45-9c32-4659d9c6cdcf,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f77f422-f7')
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Deleting instance files /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8_del
Nov 29 07:26:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Deletion of /opt/stack/data/nova/instances/43152b31-de51-4a18-8f6a-dd1617147fd8_del complete
Nov 29 07:26:04 user nova-compute[75373]: INFO nova.compute.manager [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:26:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Creating image(s)
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.208s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk 1073741824" returned: 0 in 0.062s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Successfully created port: bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] Acquiring lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] No waiting events found dispatching network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:04 user nova-compute[75373]: WARNING nova.compute.manager [req-122540f5-d469-4a86-b415-c2aedcd0cefb req-40c3a0fd-af81-4dec-92a4-e59ca6572c2f service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received unexpected event network-vif-plugged-6f77f422-f7de-4e45-9c32-4659d9c6cdcf for instance with vm_state active and task_state deleting.
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:04 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Took 0.64 seconds to deallocate network for instance.
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Cannot resize image /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Ensure instance console log exists: /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Successfully updated port: bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:26:05 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Deleted allocations for instance 43152b31-de51-4a18-8f6a-dd1617147fd8
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing instance network info cache due to event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-32e33b3c-57b2-47b0-87c6-e9c7d20ef2bc tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "43152b31-de51-4a18-8f6a-dd1617147fd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance network_info: |[{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start _get_guest_xml network_info=[{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:26:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMPlbPhQhQnyH54iqayg4Q326Sp2euaHqI4nlFgsvZy8b4uTpmXgIPWOPBRUr/cdMLe3U423H8KtW3BQmF3QRdIzs1zXLk4N/HO2r8lEmzwgEuFDgSxhBYs1vSK/6C0JQ==',key_name='tempest-keypair-2068243512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.objects.instance [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_devices' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:26:05 user nova-compute[75373]:   <uuid>fb883135-2995-4186-8251-42cae4bd57c3</uuid>
Nov 29 07:26:05 user nova-compute[75373]:   <name>instance-00000014</name>
Nov 29 07:26:05 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:26:05 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:26:05 user nova-compute[75373]:   <metadata>
Nov 29 07:26:05 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:26:05 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-603230549</nova:name>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:26:05</nova:creationTime>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:26:05 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:26:05 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:owner>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:user uuid="6d67f374467c43e1b247a4fbc69e67d0">tempest-AttachVolumeShelveTestJSON-1812012148-project-member</nova:user>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:project uuid="c7fb2c66f2ee4df08d54238965f90bc6">tempest-AttachVolumeShelveTestJSON-1812012148</nova:project>
Nov 29 07:26:05 user nova-compute[75373]:       </nova:owner>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:26:05 user nova-compute[75373]:       <nova:ports>
Nov 29 07:26:05 user nova-compute[75373]:         <nova:port uuid="bcb689a0-25f4-44c5-97a1-deb9e62d6ed8">
Nov 29 07:26:05 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:26:05 user nova-compute[75373]:         </nova:port>
Nov 29 07:26:05 user nova-compute[75373]:       </nova:ports>
Nov 29 07:26:05 user nova-compute[75373]:     </nova:instance>
Nov 29 07:26:05 user nova-compute[75373]:   </metadata>
Nov 29 07:26:05 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:26:05 user nova-compute[75373]:     <system>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="serial">fb883135-2995-4186-8251-42cae4bd57c3</entry>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="uuid">fb883135-2995-4186-8251-42cae4bd57c3</entry>
Nov 29 07:26:05 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:26:05 user nova-compute[75373]:     </system>
Nov 29 07:26:05 user nova-compute[75373]:   </sysinfo>
Nov 29 07:26:05 user nova-compute[75373]:   <os>
Nov 29 07:26:05 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:26:05 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:26:05 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:26:05 user nova-compute[75373]:   </os>
Nov 29 07:26:05 user nova-compute[75373]:   <features>
Nov 29 07:26:05 user nova-compute[75373]:     <acpi/>
Nov 29 07:26:05 user nova-compute[75373]:     <apic/>
Nov 29 07:26:05 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:26:05 user nova-compute[75373]:   </features>
Nov 29 07:26:05 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:26:05 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:26:05 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:26:05 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:26:05 user nova-compute[75373]:   </clock>
Nov 29 07:26:05 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:26:05 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:26:05 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:26:05 user nova-compute[75373]:   </cpu>
Nov 29 07:26:05 user nova-compute[75373]:   <devices>
Nov 29 07:26:05 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:26:05 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:26:05 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk"/>
Nov 29 07:26:05 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:26:05 user nova-compute[75373]:     </disk>
Nov 29 07:26:05 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:26:05 user nova-compute[75373]:       <mac address="fa:16:3e:b4:ef:46"/>
Nov 29 07:26:05 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:26:05 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:26:05 user nova-compute[75373]:       <target dev="tapbcb689a0-25"/>
Nov 29 07:26:05 user nova-compute[75373]:     </interface>
Nov 29 07:26:05 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:26:05 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/console.log" append="off"/>
Nov 29 07:26:05 user nova-compute[75373]:     </serial>
Nov 29 07:26:05 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:26:05 user nova-compute[75373]:     <video>
Nov 29 07:26:05 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:26:05 user nova-compute[75373]:     </video>
Nov 29 07:26:05 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:26:05 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:26:05 user nova-compute[75373]:     </rng>
Nov 29 07:26:05 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:26:05 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:26:05 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:26:05 user nova-compute[75373]:     </memballoon>
Nov 29 07:26:05 user nova-compute[75373]:   </devices>
Nov 29 07:26:05 user nova-compute[75373]: </domain>
Nov 29 07:26:05 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMPlbPhQhQnyH54iqayg4Q326Sp2euaHqI4nlFgsvZy8b4uTpmXgIPWOPBRUr/cdMLe3U423H8KtW3BQmF3QRdIzs1zXLk4N/HO2r8lEmzwgEuFDgSxhBYs1vSK/6C0JQ==',key_name='tempest-keypair-2068243512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG os_vif [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '825b10b4-a790-58f8-933c-78d901cf3e75', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcb689a0-25, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcb689a0-25, col_values=(('qos', UUID('c1d84341-933f-4e4b-bb62-a4ef63d65449')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcb689a0-25, col_values=(('external_ids', {'iface-id': 'bcb689a0-25f4-44c5-97a1-deb9e62d6ed8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ef:46', 'vm-uuid': 'fb883135-2995-4186-8251-42cae4bd57c3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:05 user nova-compute[75373]: INFO os_vif [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25')
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:26:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No VIF found with MAC fa:16:3e:b4:ef:46, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:26:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updated VIF entry in instance network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:26:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3b9a8b5a-ccae-4b2f-bbeb-1f1308ed8c78 req-9f10b531-dea6-4048-8686-21e693a02f50 service nova] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:26:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-9a9dbfba-4a9c-4d2a-b794-8d9e434b8fb2 req-25c457fc-cb35-46d4-8612-399e8028026e service nova] [instance: 43152b31-de51-4a18-8f6a-dd1617147fd8] Received event network-vif-deleted-6f77f422-f7de-4e45-9c32-4659d9c6cdcf {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:08 user nova-compute[75373]: WARNING nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state building and task_state spawning.
Nov 29 07:26:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:08 user nova-compute[75373]: WARNING nova.compute.manager [req-ffdcddcc-32f8-4581-8585-4ea187989b76 req-b0a60d02-975b-4b96-8280-045eaeffaa3c service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state building and task_state spawning.
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:26:09 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance spawned successfully.
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:26:09 user nova-compute[75373]: INFO nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 29 07:26:09 user nova-compute[75373]: DEBUG nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:26:09 user nova-compute[75373]: INFO nova.compute.manager [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Took 6.43 seconds to build instance.
Nov 29 07:26:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-eaf827dd-55a6-4f63-af1b-4a1f6be1bbe9 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.579s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-changed-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing instance network info cache due to event network-changed-7a84e996-fae2-4711-a6bb-80ca3fd97842. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] Acquiring lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] Acquired lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Refreshing network info cache for port 7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:26:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updated VIF entry in instance network info cache for port 7a84e996-fae2-4711-a6bb-80ca3fd97842. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:26:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97a315b7-b1ee-49d8-8dd0-d74a17c0f0c5 req-a440e3ea-eb95-463c-9186-ba813854358e service nova] Releasing lock "refresh_cache-575318f4-4431-4e30-a1a2-d3f6fb6683fd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:13 user nova-compute[75373]: INFO nova.compute.manager [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Terminating instance
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-c3ffa137-1660-424d-93ce-5419d289caed req-88318af4-dbb4-4e59-b2f0-b79d44deb3ba service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-2ba86aaf-aadd-4417-a80b-e7cd5cf3e234 req-baaf24b4-2084-4ca2-b00a-c6287f5831cd service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-1650c5d8-86f9-48bc-a663-d97262b78d93 req-a52261e2-127f-46b0-a0a8-dd79ee1d0eed service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-c2705e34-182d-4ae7-b800-9c9912042fe8 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Instance destroyed successfully.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lazy-loading 'resources' on Instance uuid 575318f4-4431-4e30-a1a2-d3f6fb6683fd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a84e996-fa, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da35de2f-2dd3-40e4-88bd-5003298b9eac) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:19:28,bridge_name='br-int',has_traffic_filtering=True,id=7a84e996-fae2-4711-a6bb-80ca3fd97842,network=Network(8d9f88cb-fd62-446f-917b-4568bbd9b8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a84e996-fa')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape24c2d40-36, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5832e0d7-f04e-4e14-b333-b2705dd15fe7) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:e6:74,bridge_name='br-int',has_traffic_filtering=True,id=e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape24c2d40-36')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2705e34-18, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5f27b08-b4d8-4afe-a4f2-09d4205ef53f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:46:0d,bridge_name='br-int',has_traffic_filtering=True,id=c2705e34-182d-4ae7-b800-9c9912042fe8,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2705e34-18')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "address": "fa:16:3e:38:43:5b", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93148e8-f2", "ovs_interfaceid": "c93148e8-f2a6-4191-8c81-f2ff29f44cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93148e8-f2, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbdea8fa-71ea-448b-9803-ca84be3e8081) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:43:5b,bridge_name='br-int',has_traffic_filtering=True,id=c93148e8-f2a6-4191-8c81-f2ff29f44cde,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93148e8-f2')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9159dced-a8, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=780dfb8f-a8a9-49fa-a5d4-91f9e5c4ddfb) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-7a84e996-fae2-4711-a6bb-80ca3fd97842 for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-81a9b3d5-dcda-4360-be9a-405195363cce req-f88cd31d-0207-4ab3-bd3f-a0639fe8c6a1 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c93148e8-f2a6-4191-8c81-f2ff29f44cde for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c4:66,bridge_name='br-int',has_traffic_filtering=True,id=9159dced-a86c-4765-b9e3-f56b4b8fed6e,network=Network(f4a6b622-fe1d-4b1a-891a-4074bd15b7c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9159dced-a8')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a4e104-89, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8157e2c2-4d80-4dc9-a8fc-cb79169e9239) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d9:e9,bridge_name='br-int',has_traffic_filtering=True,id=e1a4e104-89bb-4e60-aafb-57f204444966,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a4e104-89')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1163869178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1163869178',id=15,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgID6w2Ooo8Yjn1FvOJ1dshvtuX6Ry4Pu7LsQMqg08x6PEkhb1Y9Ngylp5IulurLCuB1UsduMhPGFfSglavAyJT5uicbXsq1J+JpQi0opOvC2DRCjSvSIFOO1dYm5fUMA==',key_name='tempest-keypair-1948839877',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b2a7d8ed704aeaabb2d865f78704d3',ramdisk_id='',reservation_id='r-xv47gscs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1391239922',owner_user_name='tempest-TaggedBootDevicesTest-1391239922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f41fb36b68d94cef8551b930eed284d5',uuid=575318f4-4431-4e30-a1a2-d3f6fb6683fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converting VIF {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc47e13-b9, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558b2f59-9881-4a60-be1e-e3ae70dfbacd) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:15 user nova-compute[75373]: INFO os_vif [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:44:87,bridge_name='br-int',has_traffic_filtering=True,id=5cc47e13-b920-426a-9ffe-c000c6678b7d,network=Network(6c50fb4d-9a69-4121-a7ca-df3d0eb20546),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc47e13-b9')
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPazMSBX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-5cc47e13-b920-426a-9ffe-c000c6678b7d for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-17389fd9-23bb-4216-b837-6a9d61093bda req-b2d3aa3c-88d2-4073-9d4e-9b685103e83a service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-5cc47e13-b920-426a-9ffe-c000c6678b7d for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b37d6-24e4-4b32-b0bc-582605703047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:26:15 user nova-compute[75373]: No targets found.
Nov 29 07:26:15 user nova-compute[75373]: iSNS:
Nov 29 07:26:15 user nova-compute[75373]: No targets found.
Nov 29 07:26:15 user nova-compute[75373]: STATIC:
Nov 29 07:26:15 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26
Nov 29 07:26:15 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:15 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:15 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f
Nov 29 07:26:15 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:15 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:15 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2
Nov 29 07:26:15 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:15 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:15 user nova-compute[75373]: FIRMWARE:
Nov 29 07:26:15 user nova-compute[75373]: No targets found.
Nov 29 07:26:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:26:15 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:26:15 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ddff6-3b89-4a28-82f7-cc9c9fdf9807]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-c2705e34-182d-4ae7-b800-9c9912042fe8 for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-9159dced-a86c-4765-b9e3-f56b4b8fed6e for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-unplugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-unplugged-e1a4e104-89bb-4e60-aafb-57f204444966 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Acquiring lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] No waiting events found dispatching network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:15 user nova-compute[75373]: WARNING nova.compute.manager [req-8a09b778-769f-4323-b471-aa9237e23d1a req-1de8247b-3612-401e-9969-fd665cc7b2df service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received unexpected event network-vif-plugged-e1a4e104-89bb-4e60-aafb-57f204444966 for instance with vm_state active and task_state deleting.
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b26f6-c563-4593-82f5-e97267f28d46]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:26:15 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:26:15 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 (non-flash)
Nov 29 07:26:15 user nova-compute[75373]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:26:15 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae021cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26'): ({'sdd'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Removing single pathed devices sdd {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe3412-28b2-4ab1-a4dc-c59ad513cb76]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119c26e-82dd-40cb-ae01-8f027c526e46]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Flushing IO for device /dev/sdd {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da571319-3d48-4a95-811f-bb5ea2079f76]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef757531-966b-4692-bcbb-6c4f6767393b]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[208ab104-2ef8-4c80-b557-c6db9ace47bc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a54213-fece-40e7-b39e-00f0b17769b5]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260]
Nov 29 07:26:15 user nova-compute[75373]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26, portal: 172.16.0.220,3260] successful.
Nov 29 07:26:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47080dae-d789-444a-8c83-79565c738f26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0faac3-ee7a-4a01-a3e0-5bdd0858d8aa]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== disconnect_volume: return (308ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLcJZfFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:26:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[19188e17-2a5a-4e1f-9eb3-8b9b140168f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]: iSNS:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]: STATIC:
Nov 29 07:26:16 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f
Nov 29 07:26:16 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:16 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:16 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2
Nov 29 07:26:16 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:16 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:16 user nova-compute[75373]: FIRMWARE:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:26:16 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:26:16 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f76d1-6d27-490b-b0ff-4105e3bab568]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2d0d8-6b02-4d39-8d48-0ab823d4f38a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:26:16 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f (non-flash)
Nov 29 07:26:16 user nova-compute[75373]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae03c6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d13bd52-f790-4d06-9513-1e44638c4df3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a812f282-9435-4dbb-8e98-7414d061d6fd]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8f167-ed4e-4ff5-b10c-91588b1e23c6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee29562-0999-4e69-ba97-93aded457476]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f43c00-dbc0-4b81-bcf3-9bba53a37d22]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465aed2-aa52-4f3a-8792-873f65f7627e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260]
Nov 29 07:26:16 user nova-compute[75373]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f, portal: 172.16.0.220,3260] successful.
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c138c9e-e639-4adf-aeb3-fb72ff8ec83f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9634174-11f1-445d-aefc-a7222281fbf6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== disconnect_volume: return (292ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buFSMHBK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:26:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d5841b-03fe-41c4-b8b8-30c850538b84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]: iSNS:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]: STATIC:
Nov 29 07:26:16 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2
Nov 29 07:26:16 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:26:16 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:26:16 user nova-compute[75373]: FIRMWARE:
Nov 29 07:26:16 user nova-compute[75373]: No targets found.
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:26:16 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:26:16 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16a997-10c7-4fd1-a532-6c7ac61eb6d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a6f32-8353-4777-a532-2657a943c3fe]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 (non-flash)
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae03c4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2'): ({'sdf'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Removing single pathed devices sdf {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c4b93-3dc6-496c-847e-7878680d0391]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1fc7d-4f8e-4a2e-a1ab-cedf688628d8]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Flushing IO for device /dev/sdf {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f39d5f-47ff-475e-bf09-327da891c029]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf69f5d-7653-4555-b317-0df2349fe895]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[00382a3a-b661-44ae-b3a5-57ad005d8bee]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcca24d-8052-4cb1-94a9-f316500b8b64]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260]
Nov 29 07:26:16 user nova-compute[75373]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2, portal: 172.16.0.220,3260] successful.
Nov 29 07:26:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3520029-94a3-4882-8fb4-f8186f97d7b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a7302-ebe8-4655-bd9c-8236e3c27c21]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] <== disconnect_volume: return (298ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:26:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Deleting instance files /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd_del
Nov 29 07:26:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Deletion of /opt/stack/data/nova/instances/575318f4-4431-4e30-a1a2-d3f6fb6683fd_del complete
Nov 29 07:26:16 user nova-compute[75373]: INFO nova.compute.manager [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Took 3.63 seconds to destroy the instance on the hypervisor.
Nov 29 07:26:16 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:26:16 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:26:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-2c08caa8-0e32-4018-adeb-4d1e69441682 req-aeaa8c64-9381-4a4c-a0a4-9bff930abadb service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-deleted-c93148e8-f2a6-4191-8c81-f2ff29f44cde {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:18 user nova-compute[75373]: INFO nova.compute.manager [req-2c08caa8-0e32-4018-adeb-4d1e69441682 req-aeaa8c64-9381-4a4c-a0a4-9bff930abadb service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Neutron deleted interface c93148e8-f2a6-4191-8c81-f2ff29f44cde; detaching it from the instance and deleting it from the info cache
Nov 29 07:26:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-2c08caa8-0e32-4018-adeb-4d1e69441682 req-aeaa8c64-9381-4a4c-a0a4-9bff930abadb service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [{"id": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "address": "fa:16:3e:09:19:28", "network": {"id": "8d9f88cb-fd62-446f-917b-4568bbd9b8e8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-903851810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a84e996-fa", "ovs_interfaceid": "7a84e996-fae2-4711-a6bb-80ca3fd97842", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "address": "fa:16:3e:d0:e6:74", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape24c2d40-36", "ovs_interfaceid": "e24c2d40-36c1-46b9-bbd0-834d2b7d4c8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2705e34-182d-4ae7-b800-9c9912042fe8", "address": "fa:16:3e:e4:46:0d", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2705e34-18", "ovs_interfaceid": "c2705e34-182d-4ae7-b800-9c9912042fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "address": "fa:16:3e:92:c4:66", "network": {"id": "f4a6b622-fe1d-4b1a-891a-4074bd15b7c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-2072662888", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9159dced-a8", "ovs_interfaceid": "9159dced-a86c-4765-b9e3-f56b4b8fed6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1a4e104-89bb-4e60-aafb-57f204444966", "address": "fa:16:3e:ff:d9:e9", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a4e104-89", "ovs_interfaceid": "e1a4e104-89bb-4e60-aafb-57f204444966", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "address": "fa:16:3e:8a:44:87", "network": {"id": "6c50fb4d-9a69-4121-a7ca-df3d0eb20546", "bridge": "br-int", "label": "tempest-device-tagging-net2-765962580", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e8b2a7d8ed704aeaabb2d865f78704d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc47e13-b9", "ovs_interfaceid": "5cc47e13-b920-426a-9ffe-c000c6678b7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-2c08caa8-0e32-4018-adeb-4d1e69441682 req-aeaa8c64-9381-4a4c-a0a4-9bff930abadb service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Detach interface failed, port_id=c93148e8-f2a6-4191-8c81-f2ff29f44cde, reason: Instance 575318f4-4431-4e30-a1a2-d3f6fb6683fd could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:20 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Took 4.05 seconds to deallocate network for instance.
Nov 29 07:26:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-6197125a-02b6-4031-8fa8-83de6cac74e5 req-dbb2ed84-1448-4f78-b383-6e1e0e2e9772 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-deleted-7a84e996-fae2-4711-a6bb-80ca3fd97842 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-6197125a-02b6-4031-8fa8-83de6cac74e5 req-dbb2ed84-1448-4f78-b383-6e1e0e2e9772 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-deleted-5cc47e13-b920-426a-9ffe-c000c6678b7d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-6197125a-02b6-4031-8fa8-83de6cac74e5 req-dbb2ed84-1448-4f78-b383-6e1e0e2e9772 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-deleted-9159dced-a86c-4765-b9e3-f56b4b8fed6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-6197125a-02b6-4031-8fa8-83de6cac74e5 req-dbb2ed84-1448-4f78-b383-6e1e0e2e9772 service nova] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Received event network-vif-deleted-e1a4e104-89bb-4e60-aafb-57f204444966 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:22 user nova-compute[75373]: INFO nova.compute.manager [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Terminating instance
Nov 29 07:26:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-unplugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] No waiting events found dispatching network-vif-unplugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-00853a72-7312-4485-8a76-c8df210e7fb8 req-666bd4fd-254c-485e-be3d-3b9937258f8f service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-unplugged-169647ce-fc89-404b-aebc-c942b87b4d6e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Instance destroyed successfully.
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lazy-loading 'resources' on Instance uuid adaf3c5c-6d17-44db-a652-1fafcc3aeefc {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-582720023',display_name='tempest-TestServerVolumeAttachmentScenario-server-582720023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-582720023',id=12,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHD+eMQdrQutCZjst7N75EK7TKkcz3bnHmyPAD9Fsp5VkbRa8ICgvz4liP+U5NggN2GC14IMXYVN8Gpt02Msf+irACfvO7bsuz2whk+0WqkyWyQa/MeCVSmH2Z+yDTJkAQ==',key_name='tempest-keypair-1049790',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49ab91942a734e9d87ba7ce6c34c0936',ramdisk_id='',reservation_id='r-q4bmc77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1945326043',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1945326043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:22:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='315062729f674d828b950a3777d3859b',uuid=adaf3c5c-6d17-44db-a652-1fafcc3aeefc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converting VIF {"id": "169647ce-fc89-404b-aebc-c942b87b4d6e", "address": "fa:16:3e:2b:c0:0d", "network": {"id": "0bc8d225-d9de-4ce7-ae23-4cecf977e453", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1012523999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49ab91942a734e9d87ba7ce6c34c0936", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap169647ce-fc", "ovs_interfaceid": "169647ce-fc89-404b-aebc-c942b87b4d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG os_vif [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap169647ce-fc, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f242244b-480f-4c36-9afc-35264f4f2ab8) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:23 user nova-compute[75373]: INFO os_vif [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c0:0d,bridge_name='br-int',has_traffic_filtering=True,id=169647ce-fc89-404b-aebc-c942b87b4d6e,network=Network(0bc8d225-d9de-4ce7-ae23-4cecf977e453),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap169647ce-fc')
Nov 29 07:26:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Deleting instance files /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc_del
Nov 29 07:26:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Deletion of /opt/stack/data/nova/instances/adaf3c5c-6d17-44db-a652-1fafcc3aeefc_del complete
Nov 29 07:26:23 user nova-compute[75373]: INFO nova.compute.manager [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 07:26:23 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:26:23 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:24 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Took 1.07 seconds to deallocate network for instance.
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-changed-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Refreshing instance network info cache due to event network-changed-69034705-573c-4d5e-8ba1-db0cab8e23c4. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] Acquiring lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] Acquired lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.network.neutron [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Refreshing network info cache for port 69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:24 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Deleted allocations for instance adaf3c5c-6d17-44db-a652-1fafcc3aeefc
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] Acquiring lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] No waiting events found dispatching network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:24 user nova-compute[75373]: WARNING nova.compute.manager [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received unexpected event network-vif-plugged-169647ce-fc89-404b-aebc-c942b87b4d6e for instance with vm_state deleted and task_state None.
Nov 29 07:26:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-96a7e755-2a5a-4dfd-bef6-dee7c72d402b req-842e5d6d-ddec-4267-819f-4437cbd24a25 service nova] [instance: adaf3c5c-6d17-44db-a652-1fafcc3aeefc] Received event network-vif-deleted-169647ce-fc89-404b-aebc-c942b87b4d6e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-047b003d-300d-4b1a-9431-5857a69ba381 tempest-TestServerVolumeAttachmentScenario-1945326043 tempest-TestServerVolumeAttachmentScenario-1945326043-project-member] Lock "adaf3c5c-6d17-44db-a652-1fafcc3aeefc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updated VIF entry in instance network info cache for port 69034705-573c-4d5e-8ba1-db0cab8e23c4. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating instance_info_cache with network_info: [{"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7bbfb4a-1a4c-4380-8db6-f2f59fd1ac64 req-daf903a5-a8bb-4f8c-afb2-738c38c15fb9 service nova] Releasing lock "refresh_cache-7e23b02c-d997-46bc-b785-51fb6ce167ee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'flavor' on Instance uuid 7e23b02c-d997-46bc-b785-51fb6ce167ee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:25 user nova-compute[75373]: INFO nova.compute.manager [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Attaching volume fd065193-7217-4c5c-b1f8-9cc982db418a to /dev/vdb
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.utils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ed6f3-2e42-4a8e-a81e-a9eeb5cbea50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea67e6-746f-4187-85fe-b92d3135b6f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[522047ce-4941-47aa-a764-1e0afc091fb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b424d-e0d3-440d-b5f4-24fc1c36b60f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:26:25 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:26:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa60a2-80e2-4380-903d-8a55643ca21e]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG os_brick.utils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:26:25 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating existing volume attachment record: fcc21749-1a60-4271-877e-0fb4d0f8ae23 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:26:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:26:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:26:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:32 user nova-compute[75373]: INFO nova.compute.manager [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] [instance: 575318f4-4431-4e30-a1a2-d3f6fb6683fd] Took 11.65 seconds to detach 3 volumes for instance.
Nov 29 07:26:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.volume.cinder [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Update attachment failed for attachment fcc21749-1a60-4271-877e-0fb4d0f8ae23. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Failed to attach fd065193-7217-4c5c-b1f8-9cc982db418a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Traceback (most recent call last):
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     self._do_attach(context, instance, volume, volume_api,
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     self._volume_attach(context, volume, connector, instance,
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     connection_info = volume_api.attachment_update(
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     res = method(self, ctx, *args, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     with excutils.save_and_reraise_exception():
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     self.force_reraise()
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     raise self.value
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     return method.func(obj, *args, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     resp = self._update('/attachments/%s' % id, body)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     return self.request(url, method, **kwargs)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee]     raise exceptions.from_response(resp, body)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88)
Nov 29 07:26:32 user nova-compute[75373]: ERROR nova.compute.manager [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] 
Nov 29 07:26:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:26:32 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:32 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.229s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.646s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server [None req-bdec4855-0898-462e-8dcb-dea61be7341c tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e07bd5e7-ade1-4f33-b8c8-af96bbe78b88)
Nov 29 07:26:33 user nova-compute[75373]: ERROR oslo_messaging.rpc.server 
Nov 29 07:26:33 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Deleted allocations for instance 575318f4-4431-4e30-a1a2-d3f6fb6683fd
Nov 29 07:26:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1ff904ac-3af1-4180-9fb3-2b2558ba79b6 tempest-TaggedBootDevicesTest-1391239922 tempest-TaggedBootDevicesTest-1391239922-project-member] Lock "575318f4-4431-4e30-a1a2-d3f6fb6683fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.234s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:26:33 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:26:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating instance_info_cache with network_info: [{"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-b791f041-3d5e-4f5f-b354-3651b9238077" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:26:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:26:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:37 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:38 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:38 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:26:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:26:43 user nova-compute[75373]: INFO nova.compute.manager [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] instance snapshotting
Nov 29 07:26:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Beginning live snapshot process
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d.delta 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d.delta 1073741824" returned: 0 in 0.052s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 07:26:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:26:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:26:45 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7440MB free_disk=25.393768310546875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:26:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:26:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 07:26:45 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:26:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d.delta /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b791f041-3d5e-4f5f-b354-3651b9238077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance fb883135-2995-4186-8251-42cae4bd57c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d.delta /opt/stack/data/nova/instances/snapshots/tmpv5p67wh8/380f7eedd2944ea0b1476464ba294e3d" returned: 0 in 0.553s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:26:46 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Snapshot extracted, beginning image upload
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:26:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.984s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:26:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:26:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Snapshot image upload complete
Nov 29 07:26:48 user nova-compute[75373]: INFO nova.compute.manager [None req-1b347c21-9f43-4ec5-a345-9f9a82d44bcc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Took 5.92 seconds to snapshot the instance on the hypervisor.
Nov 29 07:26:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:57 user nova-compute[75373]: INFO nova.compute.manager [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Terminating instance
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-unplugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] No waiting events found dispatching network-vif-unplugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-5d14bdc2-d3b3-49b5-a7ed-076a629f7eef req-bce946f7-88de-45ed-b6d2-095910111200 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-unplugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Instance destroyed successfully.
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lazy-loading 'resources' on Instance uuid b791f041-3d5e-4f5f-b354-3651b9238077 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-193948682',display_name='tempest-VolumesAdminNegativeTest-server-193948682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-193948682',id=6,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeE3AK/Nc+FLZ+vieZU1JgXf6yICUfxZyxRA/xcupW8LxXlMpkJMaL7L9svGHl3aZ/mHzeoECLc8t1iSQzwRgt+BGWldKWkzTsZVwwQ6R763qz10O9WuFhdzbNQQ9P9TA==',key_name='tempest-keypair-1264636496',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6af9d0f931c24042a73455a7ac45e87d',ramdisk_id='',reservation_id='r-5005up49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1139418558',owner_user_name='tempest-VolumesAdminNegativeTest-1139418558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbaeb2f9fc3749fb859df41acc075df2',uuid=b791f041-3d5e-4f5f-b354-3651b9238077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converting VIF {"id": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "address": "fa:16:3e:17:d8:78", "network": {"id": "75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-422408700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6af9d0f931c24042a73455a7ac45e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47aff5a9-b9", "ovs_interfaceid": "47aff5a9-b99d-4805-afc7-fea4aa29f673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG os_vif [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47aff5a9-b9, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbcd4163-f646-4c90-b70b-0380d298ff12) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:26:57 user nova-compute[75373]: INFO os_vif [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:d8:78,bridge_name='br-int',has_traffic_filtering=True,id=47aff5a9-b99d-4805-afc7-fea4aa29f673,network=Network(75d6aa7a-f6e3-4135-a6cc-735e7e8fa18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47aff5a9-b9')
Nov 29 07:26:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Deleting instance files /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077_del
Nov 29 07:26:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Deletion of /opt/stack/data/nova/instances/b791f041-3d5e-4f5f-b354-3651b9238077_del complete
Nov 29 07:26:57 user nova-compute[75373]: INFO nova.compute.manager [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 07:26:58 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:26:58 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:26:58 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:26:58 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:26:58 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Took 0.88 seconds to deallocate network for instance.
Nov 29 07:26:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-328c6ccb-66e7-4ff4-8c0d-3fa16ccfb699 req-14e16e8e-492c-41ee-a3fa-55b8f9cea849 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-deleted-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:59 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Deleted allocations for instance b791f041-3d5e-4f5f-b354-3651b9238077
Nov 29 07:26:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] Acquiring lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] Lock "b791f041-3d5e-4f5f-b354-3651b9238077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:26:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] No waiting events found dispatching network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:26:59 user nova-compute[75373]: WARNING nova.compute.manager [req-729fdcd9-4a0f-4337-9691-a1fbfb632428 req-e9b969c8-d93d-4e30-9e24-7e8466291751 service nova] [instance: b791f041-3d5e-4f5f-b354-3651b9238077] Received unexpected event network-vif-plugged-47aff5a9-b99d-4805-afc7-fea4aa29f673 for instance with vm_state deleted and task_state None.
Nov 29 07:26:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a4ff981a-4ac5-4e9d-b260-508bd2131d97 tempest-VolumesAdminNegativeTest-1139418558 tempest-VolumesAdminNegativeTest-1139418558-project-member] Lock "b791f041-3d5e-4f5f-b354-3651b9238077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-changed-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Refreshing instance network info cache due to event network-changed-825d3fb3-d49c-4814-82e1-30be81642c31. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:27:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Refreshing network info cache for port 825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:27:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updated VIF entry in instance network info cache for port 825d3fb3-d49c-4814-82e1-30be81642c31. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:27:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3129875c-8b9f-43b9-a92a-8455c210d402 req-ac1dbc4e-1d4e-4595-806f-1beeb3ff954f service nova] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:08 user nova-compute[75373]: INFO nova.compute.manager [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Attaching volume 0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 to /dev/vdb
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.utils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63d58f5-aeef-4016-879f-1b0990cb890f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a929d0e-7323-465f-be12-0c682b0a3c72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ab767-7ab5-40d0-a138-b15f1da2dadb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6fd82c-f965-48c6-bd5e-cd19385f81ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:08 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:27:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c02ca-fe83-45c1-ba87-cc1ab5a15831]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG os_brick.utils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:27:08 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating existing volume attachment record: dd0b55dc-b9cb-423f-9c8d-ae9d8ff0fbc9 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:27:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:27:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:27:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:27:16 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9dba8a-56e0-407a-8e94-31bbd3f9935a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:27:16 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af0e58-5fc3-4c9d-9f28-03747bba6e43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3] added
Nov 29 07:27:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3070126-0540-4127-9684-3dfe9ce2c678]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ac548c-2e3c-47b5-982b-d3a65ad7abe3]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOpGTLQu {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOpGTLQu" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e13632-5b53-4966-8f50-a3e347ff0351]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOpGTLQu'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff4267-dbfa-4093-9684-1d0e390c3340]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e06aa77-fa88-4026-bfa4-6aba782153d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:27:16 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:27:16 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:27:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:27:16 user nova-compute[75373]: 
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d9b64-b2e8-4de1-9934-d4da0d31c843]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]
Nov 29 07:27:16 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.
Nov 29 07:27:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9422332-c982-468c-8690-d84c4e877d2e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd394319-60bc-4248-855e-3b05ff127ee8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fe970-0632-4547-ab32-329bbd997898]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23339356464636564', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339356464636564', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:27:17 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:27:17 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:27:17 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:27:17 user nova-compute[75373]:   <serial>0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3</serial>
Nov 29 07:27:17 user nova-compute[75373]: </disk>
Nov 29 07:27:17 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:27:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:27:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:27:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No VIF found with MAC fa:16:3e:c9:28:6e, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:27:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3668009a-1ba5-49b5-83f6-bc33b6cd2d11 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.251s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75373) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:19 user nova-compute[75373]: WARNING nova.compute.manager [req-27b71f3e-043d-4891-badf-2e167c826710 req-43b3dd56-d834-4720-9dc1-1ec0bdc66a0e service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state active and task_state powering-off.
Nov 29 07:27:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance destroyed successfully.
Nov 29 07:27:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:27:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7777439d-f313-4f2b-92c7-fae311848b23 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.875s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:21 user nova-compute[75373]: WARNING nova.compute.manager [req-b89fe6b1-5130-41b2-8104-87cdcc15117b req-9d0870e1-74aa-487e-b66e-5569b6d48e9a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state None.
Nov 29 07:27:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:22 user nova-compute[75373]: INFO nova.compute.manager [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Unrescuing
Nov 29 07:27:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:27:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'flavor' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:23 user nova-compute[75373]: WARNING nova.compute.manager [req-8939da2e-7848-4e51-a7c5-100dda1a843d req-8575dd34-1603-418c-a166-da8aaed76e84 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:27:24 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance destroyed successfully.
Nov 29 07:27:24 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:25 user nova-compute[75373]: WARNING nova.compute.manager [req-b896ad8b-6a78-4945-9b06-87df89ab2d1b req-79bd52a8-2db3-48bf-9ee2-9a9751997916 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 7730c34d-5c8b-4f03-9a77-b24ce6244605 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 715c4151-deed-43c5-b786-6368742953d3 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 7e23b02c-d997-46bc-b785-51fb6ce167ee {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 7c25504f-ed6b-409c-8849-68c1ca27fe93 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: INFO nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "715c4151-deed-43c5-b786-6368742953d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "715c4151-deed-43c5-b786-6368742953d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8e06aaf9-ee4f-40bd-89a5-cfd863cbccd6 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:27 user nova-compute[75373]: WARNING nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:27:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:27 user nova-compute[75373]: WARNING nova.compute.manager [req-ed86b50b-5bfa-4796-bbc4-171c72c4ad6a req-52897076-5427-4d78-91de-ef931a1259fa service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:27:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:37 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-changed-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Refreshing instance network info cache due to event network-changed-43faadde-ad57-4b96-913b-6f6c2aab789b. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] Acquiring lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] Acquired lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG nova.network.neutron [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Refreshing network info cache for port 43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:27:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG nova.network.neutron [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updated VIF entry in instance network info cache for port 43faadde-ad57-4b96-913b-6f6c2aab789b. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG nova.network.neutron [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updating instance_info_cache with network_info: [{"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fff9b5f3-e658-4e1f-b29d-ebb45c13e1c4 req-5c3f9b9b-17f0-4265-8b27-9feaabf4674d service nova] Releasing lock "refresh_cache-4f72ae79-e38e-4973-ae0c-60d4fcf78db4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:27:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:42 user nova-compute[75373]: INFO nova.compute.manager [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Attaching volume fc12b86a-751b-42be-97cb-21acb4f2476e to /dev/vdb
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.utils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e01b4fc-63b6-44ab-b9b4-037122c003d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d8af1-87dd-44e6-bef1-78bfad4c1cb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b97c0dd-b53e-46e7-8db4-4e853daa75c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f83e47c-e418-4e24-ba4a-89a7dd95990b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:42 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:27:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[533334e1-cea0-4d37-9f90-dd629a13c946]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG os_brick.utils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updating existing volume attachment record: e497b26e-0fcd-411f-831d-b90a32baaa23 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:27:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:27:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:46 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:27:46 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.351409912109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance fb883135-2995-4186-8251-42cae4bd57c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:27:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:27:47 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:27:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:27:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyprXtbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:27:50 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:27:50 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:27:50 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1b095-ddbb-4db4-8208-ed17048412b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:27:50 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce22bde-907a-4cc9-bee5-e615a807328a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e] added
Nov 29 07:27:50 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5a9a1-5582-4eab-961b-fdadeff217df]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3872362-ad2b-4122-b6d6-9f321b5c72fa]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyprXtbV {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyprXtbV" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f39fe-fe47-46b7-b5f3-c017fe3abfb0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyprXtbV'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e082e54d-1d65-4b7a-b57e-7de5c61d0a34]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a724097-4aaf-494e-af2d-65b2c1c5522b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa33ef-1a8f-4414-9084-a2c1b2895294]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260]
Nov 29 07:27:51 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260] successful.
Nov 29 07:27:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce8ca3-6d62-4072-90c2-f24ba1b2ec1d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[924239ed-eb1a-4ae3-aa3c-6a0a2a256fe9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:51 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:27:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:27:51 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:27:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b50812-f258-4a91-a6de-0e8c7997c3bf]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyprXtbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:27:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26136383632383139', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136383632383139', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:27:52 user nova-compute[75373]: INFO nova.compute.claims [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Claim successful on node user
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:27:52 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:27:52 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:27:52 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:27:52 user nova-compute[75373]:   <serial>fc12b86a-751b-42be-97cb-21acb4f2476e</serial>
Nov 29 07:27:52 user nova-compute[75373]: </disk>
Nov 29 07:27:52 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:00:2b:11, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:27:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:27:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4856bbc1-e9a6-48ec-b30c-5a258a3882a9 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.167s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:27:52 user nova-compute[75373]: INFO nova.virt.block_device [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Booting with blank volume at /dev/vda
Nov 29 07:27:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:52 user nova-compute[75373]: DEBUG nova.policy [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7dec6d7789c4430ad19e175de4b3519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff517549ee99421aa0e9d570d4fb6941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:27:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Successfully created port: 1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:27:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Successfully updated port: 1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing instance network info cache due to event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-changed-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Refreshing instance network info cache due to event network-changed-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updated VIF entry in instance network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c9347c61-1067-48ff-8345-808e98cbea22 req-065a1f2e-93e1-41cb-bf13-1a917a3b1b18 service nova] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG nova.network.neutron [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance network_info: |[{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Refreshing network info cache for port 1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updated VIF entry in instance network info cache for port 1308faaa-a0a4-43fe-9a15-d8ba09ad85bd. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:27:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1d92e4d2-8c24-4f70-9d5a-bbf7aec99c64 req-9a017137-6d15-41b3-b80e-4d4ca84e684c service nova] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:27:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:27:58 user nova-compute[75373]: INFO nova.compute.claims [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Claim successful on node user
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.utils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a2cb0-a0b9-4a05-bc8d-e523f62a0792]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4af881-dac0-4c30-8136-ad4b291977bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc71b9-39d9-497a-8bc4-89e2a5cc00c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f47ece-153e-40a7-afed-e1e0a05af45e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:27:58 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:27:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6195b1-c512-4704-adcd-cdc20d900e82]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG os_brick.utils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:27:58 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating existing volume attachment record: bde94705-2e6e-46cf-8dba-ec21e830926f {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.policy [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fa1e258308644589a58d3ba9b99d09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32b5fe43b84c2b9df54631c7a3edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:27:59 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:59 user nova-compute[75373]: INFO nova.compute.manager [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Shelving
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:27:59 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Creating image(s)
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:27:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:27:59 user nova-compute[75373]: WARNING nova.compute.manager [req-ae5de1f6-ee67-4e5d-8620-84cbb523a4f9 req-db1499f1-c301-4b08-81f6-0f67ffc2fd80 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state active and task_state shelving.
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.214s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk 1073741824" returned: 0 in 0.056s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance destroyed successfully.
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Beginning cold snapshot process
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Cannot resize image /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Ensure instance console log exists: /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk /opt/stack/data/nova/instances/snapshots/tmp0ow1g18q/deb06ef29ba84021afd7099a6b98f2b8 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:00 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Successfully created port: 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Successfully updated port: 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquired lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:01 user nova-compute[75373]: WARNING nova.compute.manager [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-changed-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Refreshing instance network info cache due to event network-changed-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Acquiring lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk /opt/stack/data/nova/instances/snapshots/tmp0ow1g18q/deb06ef29ba84021afd7099a6b98f2b8" returned: 0 in 1.381s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Snapshot extracted, beginning image upload
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updating instance_info_cache with network_info: [{"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Releasing lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Instance network_info: |[{"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Acquired lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Refreshing network info cache for port 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Start _get_guest_xml network_info=[{"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:28:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63605660',display_name='tempest-AttachVolumeNegativeTest-server-63605660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63605660',id=22,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUFdQH528/DMU+napu32zzQmWqmRe2O5d/9JfHxglUrCHMRrIwwJTnfSozOHoXdpEW/7Wh0ZDltF3TxbubjjeyyuOOJmaHet/hCxKmN3mWfiK+pBqn3VTjMiqstS2giKg==',key_name='tempest-keypair-117331830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-u4cqb05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=7aa8bf58-5fb6-448d-8543-b703025acb36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aa8bf58-5fb6-448d-8543-b703025acb36 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:28:02 user nova-compute[75373]:   <uuid>7aa8bf58-5fb6-448d-8543-b703025acb36</uuid>
Nov 29 07:28:02 user nova-compute[75373]:   <name>instance-00000016</name>
Nov 29 07:28:02 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:28:02 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:28:02 user nova-compute[75373]:   <metadata>
Nov 29 07:28:02 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:28:02 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeNegativeTest-server-63605660</nova:name>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:28:02</nova:creationTime>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:28:02 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:28:02 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:owner>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:user uuid="0fa1e258308644589a58d3ba9b99d09a">tempest-AttachVolumeNegativeTest-2030774109-project-member</nova:user>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:project uuid="fc32b5fe43b84c2b9df54631c7a3edb9">tempest-AttachVolumeNegativeTest-2030774109</nova:project>
Nov 29 07:28:02 user nova-compute[75373]:       </nova:owner>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:28:02 user nova-compute[75373]:       <nova:ports>
Nov 29 07:28:02 user nova-compute[75373]:         <nova:port uuid="051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0">
Nov 29 07:28:02 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:28:02 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:02 user nova-compute[75373]:       </nova:ports>
Nov 29 07:28:02 user nova-compute[75373]:     </nova:instance>
Nov 29 07:28:02 user nova-compute[75373]:   </metadata>
Nov 29 07:28:02 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:28:02 user nova-compute[75373]:     <system>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="serial">7aa8bf58-5fb6-448d-8543-b703025acb36</entry>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="uuid">7aa8bf58-5fb6-448d-8543-b703025acb36</entry>
Nov 29 07:28:02 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:28:02 user nova-compute[75373]:     </system>
Nov 29 07:28:02 user nova-compute[75373]:   </sysinfo>
Nov 29 07:28:02 user nova-compute[75373]:   <os>
Nov 29 07:28:02 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:28:02 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:28:02 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:28:02 user nova-compute[75373]:   </os>
Nov 29 07:28:02 user nova-compute[75373]:   <features>
Nov 29 07:28:02 user nova-compute[75373]:     <acpi/>
Nov 29 07:28:02 user nova-compute[75373]:     <apic/>
Nov 29 07:28:02 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:28:02 user nova-compute[75373]:   </features>
Nov 29 07:28:02 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:28:02 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:28:02 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:28:02 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:28:02 user nova-compute[75373]:   </clock>
Nov 29 07:28:02 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:28:02 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:28:02 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:28:02 user nova-compute[75373]:   </cpu>
Nov 29 07:28:02 user nova-compute[75373]:   <devices>
Nov 29 07:28:02 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:28:02 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:28:02 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk"/>
Nov 29 07:28:02 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:28:02 user nova-compute[75373]:     </disk>
Nov 29 07:28:02 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:02 user nova-compute[75373]:       <mac address="fa:16:3e:23:6e:a1"/>
Nov 29 07:28:02 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:02 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:02 user nova-compute[75373]:       <target dev="tap051718a5-99"/>
Nov 29 07:28:02 user nova-compute[75373]:     </interface>
Nov 29 07:28:02 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:28:02 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/console.log" append="off"/>
Nov 29 07:28:02 user nova-compute[75373]:     </serial>
Nov 29 07:28:02 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:28:02 user nova-compute[75373]:     <video>
Nov 29 07:28:02 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:02 user nova-compute[75373]:     </video>
Nov 29 07:28:02 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:28:02 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:28:02 user nova-compute[75373]:     </rng>
Nov 29 07:28:02 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:28:02 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:28:02 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:28:02 user nova-compute[75373]:     </memballoon>
Nov 29 07:28:02 user nova-compute[75373]:   </devices>
Nov 29 07:28:02 user nova-compute[75373]: </domain>
Nov 29 07:28:02 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63605660',display_name='tempest-AttachVolumeNegativeTest-server-63605660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63605660',id=22,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUFdQH528/DMU+napu32zzQmWqmRe2O5d/9JfHxglUrCHMRrIwwJTnfSozOHoXdpEW/7Wh0ZDltF3TxbubjjeyyuOOJmaHet/hCxKmN3mWfiK+pBqn3VTjMiqstS2giKg==',key_name='tempest-keypair-117331830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-u4cqb05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=7aa8bf58-5fb6-448d-8543-b703025acb36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG os_vif [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5983ad10-c1c6-53e9-9db0-7a3fe536f8c4', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap051718a5-99, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap051718a5-99, col_values=(('qos', UUID('99d7f41f-4fbf-473d-8ca8-73fbc9776ab3')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap051718a5-99, col_values=(('external_ids', {'iface-id': '051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:6e:a1', 'vm-uuid': '7aa8bf58-5fb6-448d-8543-b703025acb36'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:02 user nova-compute[75373]: INFO os_vif [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99')
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:23:6e:a1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updated VIF entry in instance network info cache for port 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updating instance_info_cache with network_info: [{"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7191b76b-77cf-4313-b35b-41fcbbd07d36 req-a7d7d443-9ac3-49eb-a1ab-0d2311965ad1 service nova] Releasing lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] No waiting events found dispatching network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:04 user nova-compute[75373]: WARNING nova.compute.manager [req-754b3b54-4b1a-4c72-a52a-d2ed6f6c5f10 req-8b341001-9148-4d3d-a0b3-45b0e954ae21 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received unexpected event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 for instance with vm_state building and task_state spawning.
Nov 29 07:28:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Snapshot image upload complete
Nov 29 07:28:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:05 user nova-compute[75373]: INFO nova.compute.manager [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Shelve offloading
Nov 29 07:28:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance destroyed successfully.
Nov 29 07:28:05 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] No waiting events found dispatching network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:06 user nova-compute[75373]: WARNING nova.compute.manager [req-66055fbd-2da5-4ace-acfd-40002f8f0433 req-e9d7f53b-c7a9-4fc5-914c-fa1fe24953ec service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received unexpected event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 for instance with vm_state building and task_state spawning.
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:28:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Instance spawned successfully.
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:06 user nova-compute[75373]: INFO nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:06 user nova-compute[75373]: INFO nova.compute.manager [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Took 8.19 seconds to build instance.
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2fabb2e4-d488-4660-8f4f-2d24c8f28637 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.334s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance destroyed successfully.
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'resources' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMPlbPhQhQnyH54iqayg4Q326Sp2euaHqI4nlFgsvZy8b4uTpmXgIPWOPBRUr/cdMLe3U423H8KtW3BQmF3QRdIzs1zXLk4N/HO2r8lEmzwgEuFDgSxhBYs1vSK/6C0JQ==',key_name='tempest-keypair-2068243512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:28:05.124662',shelved_host='user',shelved_image_id='7b9ca56a-7536-438b-8b2e-679baf270c0d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG os_vif [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing instance network info cache due to event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcb689a0-25, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1d84341-933f-4e4b-bb62-a4ef63d65449) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:07 user nova-compute[75373]: INFO os_vif [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25')
Nov 29 07:28:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Deleting instance files /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3_del
Nov 29 07:28:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Deletion of /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3_del complete
Nov 29 07:28:07 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Deleted allocations for instance fb883135-2995-4186-8251-42cae4bd57c3
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'numa_topology' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.objects.base [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<fb883135-2995-4186-8251-42cae4bd57c3> lazy-loaded attributes: resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:28:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Creating image(s)
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Ensure instance console log exists: /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start _get_guest_xml network_info=[{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5de96a96-0082-43fa-a18d-be40468c6c8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e082533d-6115-4edc-844b-b6a8a167cc43', 'serial': 'e082533d-6115-4edc-844b-b6a8a167cc43'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'bde94705-2e6e-46cf-8dba-ec21e830926f', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:07 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:07 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:07 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updated VIF entry in instance network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbcb689a0-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bfddb2ea-53e4-44c5-8177-98a836006d22 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.527s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce9ab5f-4fb5-4cac-bd26-7cb614c49836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:28:07 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c05ffe07-a445-44e3-a4dc-345277ca4fed req-de4f4be0-9383-48e1-bc10-80914fa9b740 service nova] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[959188a1-51af-4d23-8912-1b1a08b41ddd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43] added
Nov 29 07:28:07 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:28:07 user nova-compute[75373]: INFO nova.compute.claims [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Claim successful on node user
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1b4442-dded-42cd-b301-a44f0d69f659]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9763229-6535-486c-a047-3cb18806de19]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAeajImZ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAeajImZ" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6d73e-f8b3-4cac-9f49-416b762fd890]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAeajImZ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[59131e73-7ddd-4de6-ae0c-568db6906b3e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db708279-d18d-43b9-bb1d-37c103e14696]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:08 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:08 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f21dbc-8d7c-4667-9ead-6f575e4227af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260]
Nov 29 07:28:08 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260] successful.
Nov 29 07:28:08 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[921db3b9-8af4-4ad4-83e7-3348280f9690]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0a419-85b9-4c34-ac5a-2168d4aa7ca0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:08 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:08 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ab770a-2426-40b8-acfa-ffc823fe6a9d]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:28:08 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:28:08 user nova-compute[75373]: INFO nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Booting with volume e88e08d5-af7a-490c-abb1-09b9b7b5c180 at /dev/vda
Nov 29 07:28:08 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe981a-8091-44f6-b96f-2a8a7766370e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ac233-57c8-411c-afb6-4799e3ed01ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG nova.policy [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a60fe94049864638be7c1d0f38dad82f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cede33af47b4deb831b8c57d56815b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabbf0f5-6bdf-4232-a8bb-d1062ab1a396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ade53-4ed2-4521-9a23-57071cfdf3a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:09 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:28:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf36e544-b6c5-4e20-b903-1b801c681d49]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating existing volume attachment record: d761ead1-5f89-40da-946e-18164913ab08 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23232383335393337', 'path': '/dev/sdd'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232383335393337', 'path': '/dev/sdd'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1623388813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1623388813',id=21,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-8hirr1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:27:53Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=5de96a96-0082-43fa-a18d-be40468c6c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.objects.instance [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:28:09 user nova-compute[75373]:   <uuid>5de96a96-0082-43fa-a18d-be40468c6c8d</uuid>
Nov 29 07:28:09 user nova-compute[75373]:   <name>instance-00000015</name>
Nov 29 07:28:09 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:28:09 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:28:09 user nova-compute[75373]:   <metadata>
Nov 29 07:28:09 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:28:09 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1623388813</nova:name>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:28:07</nova:creationTime>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:28:09 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:28:09 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:owner>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:28:09 user nova-compute[75373]:       </nova:owner>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:28:09 user nova-compute[75373]:       <nova:ports>
Nov 29 07:28:09 user nova-compute[75373]:         <nova:port uuid="1308faaa-a0a4-43fe-9a15-d8ba09ad85bd">
Nov 29 07:28:09 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 07:28:09 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:09 user nova-compute[75373]:       </nova:ports>
Nov 29 07:28:09 user nova-compute[75373]:     </nova:instance>
Nov 29 07:28:09 user nova-compute[75373]:   </metadata>
Nov 29 07:28:09 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:28:09 user nova-compute[75373]:     <system>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="serial">5de96a96-0082-43fa-a18d-be40468c6c8d</entry>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="uuid">5de96a96-0082-43fa-a18d-be40468c6c8d</entry>
Nov 29 07:28:09 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:28:09 user nova-compute[75373]:     </system>
Nov 29 07:28:09 user nova-compute[75373]:   </sysinfo>
Nov 29 07:28:09 user nova-compute[75373]:   <os>
Nov 29 07:28:09 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:28:09 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:28:09 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:28:09 user nova-compute[75373]:   </os>
Nov 29 07:28:09 user nova-compute[75373]:   <features>
Nov 29 07:28:09 user nova-compute[75373]:     <acpi/>
Nov 29 07:28:09 user nova-compute[75373]:     <apic/>
Nov 29 07:28:09 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:28:09 user nova-compute[75373]:   </features>
Nov 29 07:28:09 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:28:09 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:28:09 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:28:09 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:28:09 user nova-compute[75373]:   </clock>
Nov 29 07:28:09 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:28:09 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:28:09 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:28:09 user nova-compute[75373]:   </cpu>
Nov 29 07:28:09 user nova-compute[75373]:   <devices>
Nov 29 07:28:09 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:28:09 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:28:09 user nova-compute[75373]:       <source dev="/dev/sdd"/>
Nov 29 07:28:09 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:28:09 user nova-compute[75373]:       <serial>e082533d-6115-4edc-844b-b6a8a167cc43</serial>
Nov 29 07:28:09 user nova-compute[75373]:     </disk>
Nov 29 07:28:09 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:09 user nova-compute[75373]:       <mac address="fa:16:3e:9e:33:3a"/>
Nov 29 07:28:09 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:09 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:09 user nova-compute[75373]:       <target dev="tap1308faaa-a0"/>
Nov 29 07:28:09 user nova-compute[75373]:     </interface>
Nov 29 07:28:09 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:28:09 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/console.log" append="off"/>
Nov 29 07:28:09 user nova-compute[75373]:     </serial>
Nov 29 07:28:09 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:28:09 user nova-compute[75373]:     <video>
Nov 29 07:28:09 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:09 user nova-compute[75373]:     </video>
Nov 29 07:28:09 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:28:09 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:28:09 user nova-compute[75373]:     </rng>
Nov 29 07:28:09 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:28:09 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:28:09 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:28:09 user nova-compute[75373]:     </memballoon>
Nov 29 07:28:09 user nova-compute[75373]:   </devices>
Nov 29 07:28:09 user nova-compute[75373]: </domain>
Nov 29 07:28:09 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1623388813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1623388813',id=21,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-8hirr1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:27:53Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=5de96a96-0082-43fa-a18d-be40468c6c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG os_vif [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d839d49-3190-57ef-b3ea-0176c0b3ff05', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1308faaa-a0, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1308faaa-a0, col_values=(('qos', UUID('a3d3ebba-2346-4229-8bf8-2b824f5a72eb')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1308faaa-a0, col_values=(('external_ids', {'iface-id': '1308faaa-a0a4-43fe-9a15-d8ba09ad85bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:33:3a', 'vm-uuid': '5de96a96-0082-43fa-a18d-be40468c6c8d'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:09 user nova-compute[75373]: INFO os_vif [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0')
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:28:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:9e:33:3a, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:28:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully created port: a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully created port: 939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully created port: e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:28:11 user nova-compute[75373]: INFO nova.compute.claims [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Claim successful on node user
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully created port: ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:28:12 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.policy [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4c03943036e49e3b5021c5784e42ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e613704433449d9a6db31215d1b6867', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:28:12 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Creating image(s)
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.255s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully created port: 7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.222s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk 1073741824" returned: 0 in 0.080s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Cannot resize image /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Ensure instance console log exists: /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Successfully created port: 68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-a6a93a49-9645-4a99-97ba-167b6f993a61. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:28:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance spawned successfully.
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.network.neutron [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:13 user nova-compute[75373]: INFO nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 29 07:28:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:14 user nova-compute[75373]: INFO nova.compute.manager [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Took 21.95 seconds to build instance.
Nov 29 07:28:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-159e98c0-07e1-4c96-af00-f6b29fe435eb tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.061s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a147d7c6-74f6-44e0-9b39-84f55991ace8 req-9ccca365-4726-41b5-bfdc-95f30995ee7c service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Successfully updated port: 68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-changed-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Refreshing instance network info cache due to event network-changed-68cb76a9-e30c-4470-97d6-9e028490a7fe. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance network_info: |[{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Refreshing network info cache for port 68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start _get_guest_xml network_info=[{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:28:15 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:15 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'pci_devices' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:28:15 user nova-compute[75373]:   <uuid>f44b466e-2b87-414a-a4f7-d951d0a015c3</uuid>
Nov 29 07:28:15 user nova-compute[75373]:   <name>instance-00000018</name>
Nov 29 07:28:15 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:28:15 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:28:15 user nova-compute[75373]:   <metadata>
Nov 29 07:28:15 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:28:15 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127939767</nova:name>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:28:15</nova:creationTime>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:28:15 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:28:15 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:owner>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:user uuid="b4c03943036e49e3b5021c5784e42ed0">tempest-ServerActionsTestOtherB-1291056582-project-member</nova:user>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:project uuid="4e613704433449d9a6db31215d1b6867">tempest-ServerActionsTestOtherB-1291056582</nova:project>
Nov 29 07:28:15 user nova-compute[75373]:       </nova:owner>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:28:15 user nova-compute[75373]:       <nova:ports>
Nov 29 07:28:15 user nova-compute[75373]:         <nova:port uuid="68cb76a9-e30c-4470-97d6-9e028490a7fe">
Nov 29 07:28:15 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:28:15 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:15 user nova-compute[75373]:       </nova:ports>
Nov 29 07:28:15 user nova-compute[75373]:     </nova:instance>
Nov 29 07:28:15 user nova-compute[75373]:   </metadata>
Nov 29 07:28:15 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:28:15 user nova-compute[75373]:     <system>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="serial">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="uuid">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:28:15 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:28:15 user nova-compute[75373]:     </system>
Nov 29 07:28:15 user nova-compute[75373]:   </sysinfo>
Nov 29 07:28:15 user nova-compute[75373]:   <os>
Nov 29 07:28:15 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:28:15 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:28:15 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:28:15 user nova-compute[75373]:   </os>
Nov 29 07:28:15 user nova-compute[75373]:   <features>
Nov 29 07:28:15 user nova-compute[75373]:     <acpi/>
Nov 29 07:28:15 user nova-compute[75373]:     <apic/>
Nov 29 07:28:15 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:28:15 user nova-compute[75373]:   </features>
Nov 29 07:28:15 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:28:15 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:28:15 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:28:15 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:28:15 user nova-compute[75373]:   </clock>
Nov 29 07:28:15 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:28:15 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:28:15 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:28:15 user nova-compute[75373]:   </cpu>
Nov 29 07:28:15 user nova-compute[75373]:   <devices>
Nov 29 07:28:15 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:28:15 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:28:15 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk"/>
Nov 29 07:28:15 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:28:15 user nova-compute[75373]:     </disk>
Nov 29 07:28:15 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:15 user nova-compute[75373]:       <mac address="fa:16:3e:8f:df:fb"/>
Nov 29 07:28:15 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:15 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:15 user nova-compute[75373]:       <target dev="tap68cb76a9-e3"/>
Nov 29 07:28:15 user nova-compute[75373]:     </interface>
Nov 29 07:28:15 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:28:15 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/console.log" append="off"/>
Nov 29 07:28:15 user nova-compute[75373]:     </serial>
Nov 29 07:28:15 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:28:15 user nova-compute[75373]:     <video>
Nov 29 07:28:15 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:15 user nova-compute[75373]:     </video>
Nov 29 07:28:15 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:28:15 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:28:15 user nova-compute[75373]:     </rng>
Nov 29 07:28:15 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:28:15 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:28:15 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:28:15 user nova-compute[75373]:     </memballoon>
Nov 29 07:28:15 user nova-compute[75373]:   </devices>
Nov 29 07:28:15 user nova-compute[75373]: </domain>
Nov 29 07:28:15 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG os_vif [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c5c4692-9b26-5ae2-91d0-02e064d8bbae', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68cb76a9-e3, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68cb76a9-e3, col_values=(('qos', UUID('6db43777-c134-4b7d-88d5-a26be56bf648')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68cb76a9-e3, col_values=(('external_ids', {'iface-id': '68cb76a9-e30c-4470-97d6-9e028490a7fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:df:fb', 'vm-uuid': 'f44b466e-2b87-414a-a4f7-d951d0a015c3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: INFO os_vif [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No VIF found with MAC fa:16:3e:8f:df:fb, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: 07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updated VIF entry in instance network info cache for port 68cb76a9-e30c-4470-97d6-9e028490a7fe. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d4d07f82-6a8a-482c-b4da-10cc42080d61 req-f46cd8b2-f327-4e60-a5f0-789d7f2f9b7b service nova] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-b7d44359-61ea-4665-972f-95875c27f2a2. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:15 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: 939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:16 user nova-compute[75373]: WARNING nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state None.
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:16 user nova-compute[75373]: WARNING nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state None.
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-07013bc2-1169-4d62-a22e-7ddbcd09fef0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port 07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-213ac280-7ba3-40b6-9ad8-cff2d1454bd4 req-466d48b4-2e41-4998-9728-fdd27b1a77a8 service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:17 user nova-compute[75373]: WARNING nova.compute.manager [req-bb5f15b7-6a66-49cc-a1f2-b52ac953e653 req-9809bbd9-890c-4ca9-a830-9f393ea040e2 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state building and task_state spawning.
Nov 29 07:28:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-939a6aeb-8131-4f39-944c-474c7af2b8d5. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port 939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:18 user nova-compute[75373]: INFO nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Booting with volume 5ad6c50d-f27b-44dd-8928-91091d27dfc9 at /dev/vdb
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-e3e4d36b-5878-4a3a-b755-50ca18b13232. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4471cc05-8d06-431c-a415-d8c1728c86b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d7b4a1-6d7d-409a-a17e-1f43e04c2354]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e4b329-1b84-4973-a61b-fdb84f36a2b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f33cb-abbd-495c-8e56-41ad27db5dd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:18 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[240841bc-d249-4195-b2b6-0ed79dbc0524]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating existing volume attachment record: aca8aea4-94a0-4a7e-ab94-a063d58b5301 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Successfully updated port: 7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c95ceff6-2f28-4411-a968-374256643c24 req-e87a35d6-485d-4dcf-89b6-6f7f1043ebcd service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:28:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance spawned successfully.
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:19 user nova-compute[75373]: WARNING nova.compute.manager [req-0dffd9b4-ea97-4c11-9f68-96c5c2f3e2d7 req-af10aa8d-ec3b-4357-95a5-d0b83c973413 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state building and task_state spawning.
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:19 user nova-compute[75373]: INFO nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 29 07:28:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:19 user nova-compute[75373]: INFO nova.compute.manager [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Took 7.58 seconds to build instance.
Nov 29 07:28:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2d6d801b-7769-45d5-aff9-fd715f1314eb tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.751s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-7ea65cae-1b64-4669-aaab-da98da12b585. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [{"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance network_info: |[{"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port 7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:28:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updated VIF entry in instance network info cache for port 7ea65cae-1b64-4669-aaab-da98da12b585. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:28:21 user nova-compute[75373]: DEBUG nova.network.neutron [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [{"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83753fe8-051d-4810-b5f1-7d39db643da6 req-8e60fab4-5caa-4bf9-9590-7760b6444814 service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:26 user nova-compute[75373]: INFO nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Booting with volume 97a3bf4f-7355-407c-81ad-00c9e756c4bd at /dev/vdc
Nov 29 07:28:26 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7243e680-48c6-48c5-84af-dcfd876e70d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a60f56-556e-47d3-9df7-3bebe2f58498]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bcd8fb-75ee-43a8-8ce5-a16783bff3a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a6c99-9d96-4fe9-abf9-566e415a22f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:28:27 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:28:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb68dfc-2db1-4652-9f9a-126e90789323]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG os_brick.utils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:27 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating existing volume attachment record: 5af36a59-69bf-4710-999c-f871df506fa8 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:28:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:34 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:28:35 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Creating image(s)
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Ensure instance console log exists: /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Start _get_guest_xml network_info=[{"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHbpdLqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f526a92-a0db-4cde-9d68-765ff3d11470', 'attached_at': '', 'detached_at': '', 'volume_id': 'e88e08d5-af7a-490c-abb1-09b9b7b5c180', 'serial': 'e88e08d5-af7a-490c-abb1-09b9b7b5c180'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'd761ead1-5f89-40da-946e-18164913ab08', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'disDAMTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f526a92-a0db-4cde-9d68-765ff3d11470', 'attached_at': '', 'detached_at': '', 'volume_id': '5ad6c50d-f27b-44dd-8928-91091d27dfc9', 'serial': '5ad6c50d-f27b-44dd-8928-91091d27dfc9'}, 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': 'aca8aea4-94a0-4a7e-ab94-a063d58b5301', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFnPBjtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f526a92-a0db-4cde-9d68-765ff3d11470', 'attached_at': '', 'detached_at': '', 'volume_id': '97a3bf4f-7355-407c-81ad-00c9e756c4bd', 'serial': '97a3bf4f-7355-407c-81ad-00c9e756c4bd'}, 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '5af36a59-69bf-4710-999c-f871df506fa8', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:28:35 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:35 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHbpdLqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:35 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:35 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:35 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid 7730c34d-5c8b-4f03-9a77-b24ce6244605 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed1f04-e4bd-4553-b342-c495d73bdf86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:28:35 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[564bd23b-724f-42a9-b057-3b70ae9b8434]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180] added
Nov 29 07:28:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce589e14-019c-4042-a4a3-809d1a30bdeb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3824c039-c0bc-4307-b6e3-f273b6e3cd2e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHbpdLqf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHbpdLqf" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6046caeb-3021-4b9e-ac1d-bc8b4f84c847]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHbpdLqf'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0355687-d72e-4d9b-b47e-a89c2a8b3e1f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfdf080-127a-4003-b112-0efd590e7aa5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64e385-c518-4c02-8992-40443f78c876]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260]
Nov 29 07:28:36 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260] successful.
Nov 29 07:28:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaeb6bf-7b9b-4eeb-af36-7ff13ec9a1b6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5699ac3f-c37b-48cb-bb2c-ed0dd0509a2a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe74225-3eb0-44e1-a014-e22a5f9d4222]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHbpdLqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [{"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-7730c34d-5c8b-4f03-9a77-b24ce6244605" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:28:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23331623137623734', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331623137623734', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'disDAMTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:37 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:37 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:37 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7f1852-9a7b-4e54-b0b6-d605bc84d291]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:28:37 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8db50-c087-4b28-94fa-cab04567cc19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9] added
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf9e6d-806e-4a58-a82f-a7ed7a4eedac]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9eb257-1cc3-418b-849d-5587738c5f01]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v disDAMTa {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v disDAMTa" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5e552-d8be-4ec3-96b6-b981c29931ee]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'disDAMTa'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[923f2afd-90d3-4731-abaa-53f35c36c715]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cc8d9d-1670-4733-a566-f13029d1037b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0723b575-4046-4306-a3d7-e5d2c5ecc905]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260]
Nov 29 07:28:37 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260] successful.
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ba43ea-78c2-4d55-9c9d-9b1b4d0a3365]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a6d11-3e81-4973-9c9e-b658e53f0f9c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:37 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eb53ea-a5aa-476d-a8a2-f802be955d28]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:37 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'disDAMTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26633633234343634', 'path': '/dev/sdf'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633633234343634', 'path': '/dev/sdf'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFnPBjtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:28:38 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:38 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:28:38 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[be710f37-59f0-4fce-bb88-ecb33821b248]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:28:38 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694dabb-c0c6-4e29-ae13-cdf16900b671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd] added
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7190e87-e836-4a94-9aa8-434065e2e0bd]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b8871-11f7-43a7-835c-cd36bea2ee1e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFnPBjtQ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFnPBjtQ" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[60548175-fb54-4e7a-8542-a48038007460]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFnPBjtQ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a9473-6ce9-43fa-be0f-bd0600b624db]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f045f481-3d8a-4b96-b1c8-b9f7c6a58df0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd59c6f-2c05-4461-b7df-4fefc42e0afc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260]
Nov 29 07:28:38 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260] successful.
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f37cc20-7015-4b52-bd86-1cc4bbeeb051]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0360b980-6356-480c-a6e1-da5346c632ac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:28:38 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:28:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aed7f4-1a6e-4175-9f6d-0cdb988732d4]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:28:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFnPBjtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26164346138653934', 'path': '/dev/sdg'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164346138653934', 'path': '/dev/sdg'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f526a92-a0db-4cde-9d68-765ff3d11470 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:28:39 user nova-compute[75373]:   <uuid>5f526a92-a0db-4cde-9d68-765ff3d11470</uuid>
Nov 29 07:28:39 user nova-compute[75373]:   <name>instance-00000017</name>
Nov 29 07:28:39 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:28:39 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:28:39 user nova-compute[75373]:   <metadata>
Nov 29 07:28:39 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:28:39 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:name>tempest-device-tagging-server-1068111306</nova:name>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:28:35</nova:creationTime>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:28:39 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:28:39 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:owner>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:user uuid="a60fe94049864638be7c1d0f38dad82f">tempest-TaggedBootDevicesTest_v242-1458404939-project-member</nova:user>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:project uuid="9cede33af47b4deb831b8c57d56815b5">tempest-TaggedBootDevicesTest_v242-1458404939</nova:project>
Nov 29 07:28:39 user nova-compute[75373]:       </nova:owner>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:28:39 user nova-compute[75373]:       <nova:ports>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="a6a93a49-9645-4a99-97ba-167b6f993a61">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="b7d44359-61ea-4665-972f-95875c27f2a2">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="07013bc2-1169-4d62-a22e-7ddbcd09fef0">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.21" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="939a6aeb-8131-4f39-944c-474c7af2b8d5">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="e3e4d36b-5878-4a3a-b755-50ca18b13232">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:         <nova:port uuid="7ea65cae-1b64-4669-aaab-da98da12b585">
Nov 29 07:28:39 user nova-compute[75373]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 07:28:39 user nova-compute[75373]:         </nova:port>
Nov 29 07:28:39 user nova-compute[75373]:       </nova:ports>
Nov 29 07:28:39 user nova-compute[75373]:     </nova:instance>
Nov 29 07:28:39 user nova-compute[75373]:   </metadata>
Nov 29 07:28:39 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:28:39 user nova-compute[75373]:     <system>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="serial">5f526a92-a0db-4cde-9d68-765ff3d11470</entry>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="uuid">5f526a92-a0db-4cde-9d68-765ff3d11470</entry>
Nov 29 07:28:39 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:28:39 user nova-compute[75373]:     </system>
Nov 29 07:28:39 user nova-compute[75373]:   </sysinfo>
Nov 29 07:28:39 user nova-compute[75373]:   <os>
Nov 29 07:28:39 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:28:39 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:28:39 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:28:39 user nova-compute[75373]:   </os>
Nov 29 07:28:39 user nova-compute[75373]:   <features>
Nov 29 07:28:39 user nova-compute[75373]:     <acpi/>
Nov 29 07:28:39 user nova-compute[75373]:     <apic/>
Nov 29 07:28:39 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:28:39 user nova-compute[75373]:   </features>
Nov 29 07:28:39 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:28:39 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:28:39 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:28:39 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:28:39 user nova-compute[75373]:   </clock>
Nov 29 07:28:39 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:28:39 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:28:39 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:28:39 user nova-compute[75373]:   </cpu>
Nov 29 07:28:39 user nova-compute[75373]:   <devices>
Nov 29 07:28:39 user nova-compute[75373]:     <disk type="file" device="cdrom">
Nov 29 07:28:39 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 07:28:39 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/disk.config"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="hda" bus="ide"/>
Nov 29 07:28:39 user nova-compute[75373]:     </disk>
Nov 29 07:28:39 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:28:39 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:28:39 user nova-compute[75373]:       <source dev="/dev/sde"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <serial>e88e08d5-af7a-490c-abb1-09b9b7b5c180</serial>
Nov 29 07:28:39 user nova-compute[75373]:     </disk>
Nov 29 07:28:39 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:28:39 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:28:39 user nova-compute[75373]:       <source dev="/dev/sdf"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <serial>5ad6c50d-f27b-44dd-8928-91091d27dfc9</serial>
Nov 29 07:28:39 user nova-compute[75373]:     </disk>
Nov 29 07:28:39 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:28:39 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:28:39 user nova-compute[75373]:       <source dev="/dev/sdg"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="vdc" bus="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <serial>97a3bf4f-7355-407c-81ad-00c9e756c4bd</serial>
Nov 29 07:28:39 user nova-compute[75373]:     </disk>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:e4:dc:ef"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tapa6a93a49-96"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:28:ab:6e"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tapb7d44359-61"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:49:da:0a"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tap07013bc2-11"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:2f:35:0e"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tap939a6aeb-81"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:b4:7e:c2"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tape3e4d36b-58"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:60:eb:5f"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tapddc0e3e1-ee"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:28:39 user nova-compute[75373]:       <mac address="fa:16:3e:08:d7:46"/>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:28:39 user nova-compute[75373]:       <target dev="tap7ea65cae-1b"/>
Nov 29 07:28:39 user nova-compute[75373]:     </interface>
Nov 29 07:28:39 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:28:39 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/console.log" append="off"/>
Nov 29 07:28:39 user nova-compute[75373]:     </serial>
Nov 29 07:28:39 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:28:39 user nova-compute[75373]:     <video>
Nov 29 07:28:39 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:28:39 user nova-compute[75373]:     </video>
Nov 29 07:28:39 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:28:39 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:28:39 user nova-compute[75373]:     </rng>
Nov 29 07:28:39 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:28:39 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:28:39 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:28:39 user nova-compute[75373]:     </memballoon>
Nov 29 07:28:39 user nova-compute[75373]:   </devices>
Nov 29 07:28:39 user nova-compute[75373]: </domain>
Nov 29 07:28:39 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '221786e0-aca0-5387-8a35-0f56c594f139', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6a93a49-96, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6a93a49-96, col_values=(('qos', UUID('af36f4ff-a843-416d-b565-d3a14b0c6ccb')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6a93a49-96, col_values=(('external_ids', {'iface-id': 'a6a93a49-9645-4a99-97ba-167b6f993a61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:dc:ef', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fccf73c-a93f-541e-83d0-e89f532c77fe', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d44359-61, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7d44359-61, col_values=(('qos', UUID('da4ad92f-d6c0-4d2a-8468-8138daa71b7e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7d44359-61, col_values=(('external_ids', {'iface-id': 'b7d44359-61ea-4665-972f-95875c27f2a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ab:6e', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97942583-aa61-5a4c-83d0-62f7d03cec88', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07013bc2-11, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07013bc2-11, col_values=(('qos', UUID('0abbb099-5464-47ad-bea9-3b3d2850c385')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07013bc2-11, col_values=(('external_ids', {'iface-id': '07013bc2-1169-4d62-a22e-7ddbcd09fef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:da:0a', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61c2f80e-85d0-59ba-bbc1-d9fc5e835031', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap939a6aeb-81, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap939a6aeb-81, col_values=(('qos', UUID('33bad2da-d6bb-4fb3-8c3d-7852c6d3b419')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap939a6aeb-81, col_values=(('external_ids', {'iface-id': '939a6aeb-8131-4f39-944c-474c7af2b8d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:35:0e', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f094ee22-1e1e-55a2-920d-ed3865fc32c7', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3e4d36b-58, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3e4d36b-58, col_values=(('qos', UUID('871d0ff8-9c52-4e29-a60c-ddc2a7c12cc7')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3e4d36b-58, col_values=(('external_ids', {'iface-id': 'e3e4d36b-5878-4a3a-b755-50ca18b13232', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:7e:c2', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e68b8fc3-ac9e-54a8-9c63-3ba44b87833f', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc0e3e1-ee, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddc0e3e1-ee, col_values=(('qos', UUID('880ac758-943f-4ba6-b0d8-aa90d80ae667')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddc0e3e1-ee, col_values=(('external_ids', {'iface-id': 'ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:eb:5f', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '192c977c-0e50-5961-8374-2088a937a929', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ea65cae-1b, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ea65cae-1b, col_values=(('qos', UUID('02a37086-b847-483d-a312-9e91663e9d41')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ea65cae-1b, col_values=(('external_ids', {'iface-id': '7ea65cae-1b64-4669-aaab-da98da12b585', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:d7:46', 'vm-uuid': '5f526a92-a0db-4cde-9d68-765ff3d11470'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:40 user nova-compute[75373]: INFO os_vif [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b')
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] No BDM found with device name hda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] No VIF found with MAC fa:16:3e:e4:dc:ef, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:28:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] No VIF found with MAC fa:16:3e:b4:7e:c2, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:28:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Using config drive
Nov 29 07:28:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Creating config drive at /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/disk.config
Nov 29 07:28:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvoymsz7_ {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvoymsz7_" returned: 0 in 0.052s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:41 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:42 user nova-compute[75373]: WARNING nova.compute.manager [req-f711e1ec-e0e5-4553-b643-6e6b07204aa2 req-bb0547e8-233e-441f-a5b8-f3cd1f403fef service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 for instance with vm_state building and task_state spawning.
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:43 user nova-compute[75373]: WARNING nova.compute.manager [req-051392d9-2fc1-48a9-b5aa-de5c1da8fa71 req-ab2f189d-daef-4bdd-a485-1501581fff58 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 for instance with vm_state building and task_state spawning.
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:43 user nova-compute[75373]: WARNING nova.compute.manager [req-c08833d4-fadb-43f9-8d13-069d56bf67bf req-81eb972e-d88a-48a5-9437-2274c429efd9 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 for instance with vm_state building and task_state spawning.
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-59d85d02-13ee-4c8c-99de-4209fb3e1b03 req-e13febab-d708-4b0a-a6b7-e81e3d44874f service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-9e869c63-208d-4ec4-8ec8-637c76d85c55 req-4ffaf5e1-41f8-432f-a2d6-c096c6127c2c service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:28:45 user nova-compute[75373]: WARNING nova.compute.manager [req-4fa9c8d1-808f-4078-9ebf-9606bc7e849c req-c3638c97-faf4-40b9-82e1-66b9114e45bc service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 for instance with vm_state building and task_state spawning.
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:28:46 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance spawned successfully.
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:46 user nova-compute[75373]: INFO nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Took 11.17 seconds to spawn the instance on the hypervisor.
Nov 29 07:28:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:47 user nova-compute[75373]: INFO nova.compute.manager [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Took 39.11 seconds to build instance.
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fddd5595-93d6-4da9-bf42-11969de6cdb8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.339s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:28:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:28:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7648MB free_disk=25.249557495117188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:28:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7aa8bf58-5fb6-448d-8543-b703025acb36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5f526a92-a0db-4cde-9d68-765ff3d11470 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:28:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:28:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:28:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:28:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:29:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'info_cache' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance destroyed successfully.
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'resources' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap825d3fb3-d4, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f7e5745-f033-41ff-aabb-8be310516ad2) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:10 user nova-compute[75373]: INFO os_vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:29:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:29:10 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d63a44-4802-41ae-bda9-f713a5e4fdc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:29:10 user nova-compute[75373]: No targets found.
Nov 29 07:29:10 user nova-compute[75373]: iSNS:
Nov 29 07:29:10 user nova-compute[75373]: No targets found.
Nov 29 07:29:10 user nova-compute[75373]: STATIC:
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:29:10 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:29:10 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:29:10 user nova-compute[75373]: FIRMWARE:
Nov 29 07:29:10 user nova-compute[75373]: No targets found.
Nov 29 07:29:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:29:10 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:29:10 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d1f61-6342-4799-9328-20e0e3cedf8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf835e-be66-4bbc-9cee-848a8cc5a057]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:10 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae05124d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ad0be-a0cd-4c73-a3a3-c85c17cb08c0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d3a53-40d2-4977-a20d-1606234944cb]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[344247d7-3075-4f58-b16d-938b09829df7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[86efb169-dfab-4cf0-a85e-b803fb7568ce]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3784a6a-cb89-49aa-bcaf-dba4392e0754]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0574e95b-a2b7-4c79-97c3-8cae182f28c9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]
Nov 29 07:29:11 user nova-compute[75373]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c67f45-4380-4c25-a8bf-e15748fb99b5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== disconnect_volume: return (316ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start _get_guest_xml network_info=[{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5bfdfeb1-6da4-4f38-8c3d-ea1af1222680', 'attached_at': '', 'detached_at': '', 'volume_id': '0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'serial': '0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'dd0b55dc-b9cb-423f-9c8d-ae9d8ff0fbc9', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'numa_topology' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:29:11 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:29:11 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:29:11 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7d44f5-a4e6-401f-91f6-0f2965db5f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:29:11 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d24148-27ea-4b8f-ae00-34a38e42cf02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3] added
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd7099-308b-44d4-be0b-963695b39c30]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffdb8f4-ece0-4211-a4d6-0c855f64230b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOpGTLQu {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOpGTLQu" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92bfc2-df50-4d6d-bc53-bb4446da0435]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOpGTLQu'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bb45f-ccd9-4442-9dfd-89b6e68c8ec9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4571fa7a-fef8-43fb-8267-11e560d30bb5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e00cf6-12c6-4ee5-9f86-09778d699de2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]
Nov 29 07:29:11 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90cbb7c-a812-4d2f-b352-e2f8eae9eadf]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[361ca89e-3cc7-4c7a-8c5f-dbb9db798971]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:11 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fa74b-a683-4565-9390-3ad8eda5b93c]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23339356464636564', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339356464636564', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:29:12 user nova-compute[75373]:   <uuid>5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</uuid>
Nov 29 07:29:12 user nova-compute[75373]:   <name>instance-00000012</name>
Nov 29 07:29:12 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:29:12 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:29:12 user nova-compute[75373]:   <metadata>
Nov 29 07:29:12 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:29:12 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeTestJSON-server-770343245</nova:name>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:29:11</nova:creationTime>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:29:12 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:29:12 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:owner>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:user uuid="f571f40d066b4d198fcf6d49c22ad1c1">tempest-AttachVolumeTestJSON-1182766882-project-member</nova:user>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:project uuid="249771bcbe724be3ac7c15231dd07e45">tempest-AttachVolumeTestJSON-1182766882</nova:project>
Nov 29 07:29:12 user nova-compute[75373]:       </nova:owner>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:29:12 user nova-compute[75373]:       <nova:ports>
Nov 29 07:29:12 user nova-compute[75373]:         <nova:port uuid="825d3fb3-d49c-4814-82e1-30be81642c31">
Nov 29 07:29:12 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:29:12 user nova-compute[75373]:         </nova:port>
Nov 29 07:29:12 user nova-compute[75373]:       </nova:ports>
Nov 29 07:29:12 user nova-compute[75373]:     </nova:instance>
Nov 29 07:29:12 user nova-compute[75373]:   </metadata>
Nov 29 07:29:12 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:29:12 user nova-compute[75373]:     <system>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="serial">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="uuid">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:29:12 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:29:12 user nova-compute[75373]:     </system>
Nov 29 07:29:12 user nova-compute[75373]:   </sysinfo>
Nov 29 07:29:12 user nova-compute[75373]:   <os>
Nov 29 07:29:12 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:29:12 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:29:12 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:29:12 user nova-compute[75373]:   </os>
Nov 29 07:29:12 user nova-compute[75373]:   <features>
Nov 29 07:29:12 user nova-compute[75373]:     <acpi/>
Nov 29 07:29:12 user nova-compute[75373]:     <apic/>
Nov 29 07:29:12 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:29:12 user nova-compute[75373]:   </features>
Nov 29 07:29:12 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:29:12 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:29:12 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:29:12 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:29:12 user nova-compute[75373]:   </clock>
Nov 29 07:29:12 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:29:12 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:29:12 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:29:12 user nova-compute[75373]:   </cpu>
Nov 29 07:29:12 user nova-compute[75373]:   <devices>
Nov 29 07:29:12 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:29:12 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:29:12 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk"/>
Nov 29 07:29:12 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:29:12 user nova-compute[75373]:     </disk>
Nov 29 07:29:12 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:29:12 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:29:12 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:29:12 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:29:12 user nova-compute[75373]:       <serial>0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3</serial>
Nov 29 07:29:12 user nova-compute[75373]:     </disk>
Nov 29 07:29:12 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:29:12 user nova-compute[75373]:       <mac address="fa:16:3e:c9:28:6e"/>
Nov 29 07:29:12 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:12 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:29:12 user nova-compute[75373]:       <target dev="tap825d3fb3-d4"/>
Nov 29 07:29:12 user nova-compute[75373]:     </interface>
Nov 29 07:29:12 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:29:12 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/console.log" append="off"/>
Nov 29 07:29:12 user nova-compute[75373]:     </serial>
Nov 29 07:29:12 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:29:12 user nova-compute[75373]:     <video>
Nov 29 07:29:12 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:12 user nova-compute[75373]:     </video>
Nov 29 07:29:12 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:29:12 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:29:12 user nova-compute[75373]:     </rng>
Nov 29 07:29:12 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:29:12 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:29:12 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:29:12 user nova-compute[75373]:     </memballoon>
Nov 29 07:29:12 user nova-compute[75373]:   </devices>
Nov 29 07:29:12 user nova-compute[75373]: </domain>
Nov 29 07:29:12 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:12 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'migration_context' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.objects.base [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG os_vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '475d8446-9b98-5d5e-8885-926c75a1355c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap825d3fb3-d4, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap825d3fb3-d4, col_values=(('qos', UUID('08c31fc8-c147-4e3c-9fec-c14556c24a0f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap825d3fb3-d4, col_values=(('external_ids', {'iface-id': '825d3fb3-d49c-4814-82e1-30be81642c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:28:6e', 'vm-uuid': '5bfdfeb1-6da4-4f38-8c3d-ea1af1222680'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:13 user nova-compute[75373]: INFO os_vif [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:29:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:14 user nova-compute[75373]: WARNING nova.compute.manager [req-f8550fad-513e-4ac6-92bb-5199dfad02bf req-a8ec7eac-6908-4046-90db-154a4c9b09b5 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state powering-on.
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:29:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance rebooted successfully.
Nov 29 07:29:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fbe0dfd1-e8c4-42f0-ab8f-ce5d9b60cd8c tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:29:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:17 user nova-compute[75373]: WARNING nova.compute.manager [req-7318da6c-9c6b-4b17-9494-d6acee375fcb req-0a87a839-d23c-418a-8c1b-71743b2c6a97 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state active and task_state None.
Nov 29 07:29:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:29:19 user nova-compute[75373]: INFO nova.compute.claims [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Claim successful on node user
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:29:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:29:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Creating image(s)
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG nova.policy [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '333925d6528d4e68bd23098c2f3513e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4259f5c423c347c8b36a7594ccec40cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk 1073741824" returned: 0 in 0.050s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Cannot resize image /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Ensure instance console log exists: /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:21 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Successfully created port: 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Successfully updated port: 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing instance network info cache due to event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance network_info: |[{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.neutron [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start _get_guest_xml network_info=[{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:29:22 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:22 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-161525513',display_name='tempest-ServerRescueNegativeTestJSON-server-161525513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-161525513',id=25,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY5CnNp5r34Hzz+zYVMb1RWStDYZDnAoGx/DpjoUZVNkg/fAO2qH6a9KOin6R23XcjuI7yxpjf/iAPETktSjg+oc3/7hjmV8jKyiCRaWTE794dLUnl6+mfqHGM3+87KUw==',key_name='tempest-keypair-54276433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-bpmc1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333925d6528d4e68bd23098c2f3513e5',uuid=24470f28-4e72-4636-bcca-b0f45051aaeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.objects.instance [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:29:22 user nova-compute[75373]:   <uuid>24470f28-4e72-4636-bcca-b0f45051aaeb</uuid>
Nov 29 07:29:22 user nova-compute[75373]:   <name>instance-00000019</name>
Nov 29 07:29:22 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:29:22 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:29:22 user nova-compute[75373]:   <metadata>
Nov 29 07:29:22 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:29:22 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-161525513</nova:name>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:29:22</nova:creationTime>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:29:22 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:29:22 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:owner>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:29:22 user nova-compute[75373]:       </nova:owner>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:29:22 user nova-compute[75373]:       <nova:ports>
Nov 29 07:29:22 user nova-compute[75373]:         <nova:port uuid="33a9f936-8b7c-4c7a-b444-5cf150dc687e">
Nov 29 07:29:22 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:29:22 user nova-compute[75373]:         </nova:port>
Nov 29 07:29:22 user nova-compute[75373]:       </nova:ports>
Nov 29 07:29:22 user nova-compute[75373]:     </nova:instance>
Nov 29 07:29:22 user nova-compute[75373]:   </metadata>
Nov 29 07:29:22 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:29:22 user nova-compute[75373]:     <system>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="serial">24470f28-4e72-4636-bcca-b0f45051aaeb</entry>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="uuid">24470f28-4e72-4636-bcca-b0f45051aaeb</entry>
Nov 29 07:29:22 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:29:22 user nova-compute[75373]:     </system>
Nov 29 07:29:22 user nova-compute[75373]:   </sysinfo>
Nov 29 07:29:22 user nova-compute[75373]:   <os>
Nov 29 07:29:22 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:29:22 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:29:22 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:29:22 user nova-compute[75373]:   </os>
Nov 29 07:29:22 user nova-compute[75373]:   <features>
Nov 29 07:29:22 user nova-compute[75373]:     <acpi/>
Nov 29 07:29:22 user nova-compute[75373]:     <apic/>
Nov 29 07:29:22 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:29:22 user nova-compute[75373]:   </features>
Nov 29 07:29:22 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:29:22 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:29:22 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:29:22 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:29:22 user nova-compute[75373]:   </clock>
Nov 29 07:29:22 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:29:22 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:29:22 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:29:22 user nova-compute[75373]:   </cpu>
Nov 29 07:29:22 user nova-compute[75373]:   <devices>
Nov 29 07:29:22 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:29:22 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:29:22 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk"/>
Nov 29 07:29:22 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:29:22 user nova-compute[75373]:     </disk>
Nov 29 07:29:22 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:29:22 user nova-compute[75373]:       <mac address="fa:16:3e:28:cf:ad"/>
Nov 29 07:29:22 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:22 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:29:22 user nova-compute[75373]:       <target dev="tap33a9f936-8b"/>
Nov 29 07:29:22 user nova-compute[75373]:     </interface>
Nov 29 07:29:22 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:29:22 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/console.log" append="off"/>
Nov 29 07:29:22 user nova-compute[75373]:     </serial>
Nov 29 07:29:22 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:29:22 user nova-compute[75373]:     <video>
Nov 29 07:29:22 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:22 user nova-compute[75373]:     </video>
Nov 29 07:29:22 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:29:22 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:29:22 user nova-compute[75373]:     </rng>
Nov 29 07:29:22 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:29:22 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:29:22 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:29:22 user nova-compute[75373]:     </memballoon>
Nov 29 07:29:22 user nova-compute[75373]:   </devices>
Nov 29 07:29:22 user nova-compute[75373]: </domain>
Nov 29 07:29:22 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-161525513',display_name='tempest-ServerRescueNegativeTestJSON-server-161525513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-161525513',id=25,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY5CnNp5r34Hzz+zYVMb1RWStDYZDnAoGx/DpjoUZVNkg/fAO2qH6a9KOin6R23XcjuI7yxpjf/iAPETktSjg+oc3/7hjmV8jKyiCRaWTE794dLUnl6+mfqHGM3+87KUw==',key_name='tempest-keypair-54276433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-bpmc1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333925d6528d4e68bd23098c2f3513e5',uuid=24470f28-4e72-4636-bcca-b0f45051aaeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG os_vif [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4bad18a-adb0-5dc6-b8ab-7ff5b5851cc0', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33a9f936-8b, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33a9f936-8b, col_values=(('qos', UUID('6ca77663-15c8-4fc6-80f3-a08a0e9a138b')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33a9f936-8b, col_values=(('external_ids', {'iface-id': '33a9f936-8b7c-4c7a-b444-5cf150dc687e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:cf:ad', 'vm-uuid': '24470f28-4e72-4636-bcca-b0f45051aaeb'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:22 user nova-compute[75373]: INFO os_vif [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b')
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:29:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:28:cf:ad, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:29:23 user nova-compute[75373]: DEBUG nova.network.neutron [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updated VIF entry in instance network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:29:23 user nova-compute[75373]: DEBUG nova.network.neutron [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efff6995-d733-42bc-b2be-4c87a72d9cfe req-eb74db52-128d-4f91-800d-80c7a9fda1b7 service nova] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:24 user nova-compute[75373]: WARNING nova.compute.manager [req-7bf068d6-13f8-4f74-aa7e-8f13f4b5c1cf req-223391c8-dcc1-4e58-90f8-96d9df1f3efb service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state building and task_state spawning.
Nov 29 07:29:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.compute.claims [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Claim successful on node user
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance spawned successfully.
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:26 user nova-compute[75373]: WARNING nova.compute.manager [req-a13994d1-1ae3-4dbb-8ed3-0ffa1b157bca req-58e2c872-36fd-4394-b765-d8f1f5f4d2d0 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state building and task_state spawning.
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.compute.manager [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Took 7.72 seconds to build instance.
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40682069-79da-400c-9ca1-b16971dd5a67 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.820s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.policy [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09780199e5494517ade9171aeaa5eae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc5739c33ed4c0ab7cd0f16a62eb0af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:29:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Creating image(s)
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "/opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "/opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk 1073741824" returned: 0 in 0.062s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.224s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Successfully created port: f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Cannot resize image /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Successfully updated port: f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:29:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquired lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:29:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing instance network info cache due to event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] Acquiring lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Releasing lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Instance network_info: |[{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] Acquired lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Start _get_guest_xml network_info=[{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:29:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1546011437',display_name='tempest-TestStampPattern-server-1546011437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1546011437',id=26,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-scmgrcln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:27Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=ae9d3db8-d3ac-4cfc-81ac-e585aeb53338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.objects.instance [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:29:29 user nova-compute[75373]:   <uuid>ae9d3db8-d3ac-4cfc-81ac-e585aeb53338</uuid>
Nov 29 07:29:29 user nova-compute[75373]:   <name>instance-0000001a</name>
Nov 29 07:29:29 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:29:29 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:29:29 user nova-compute[75373]:   <metadata>
Nov 29 07:29:29 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:29:29 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:name>tempest-TestStampPattern-server-1546011437</nova:name>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:29:29</nova:creationTime>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:29:29 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:29:29 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:owner>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:user uuid="09780199e5494517ade9171aeaa5eae3">tempest-TestStampPattern-110582567-project-member</nova:user>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:project uuid="2fc5739c33ed4c0ab7cd0f16a62eb0af">tempest-TestStampPattern-110582567</nova:project>
Nov 29 07:29:29 user nova-compute[75373]:       </nova:owner>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:29:29 user nova-compute[75373]:       <nova:ports>
Nov 29 07:29:29 user nova-compute[75373]:         <nova:port uuid="f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a">
Nov 29 07:29:29 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 07:29:29 user nova-compute[75373]:         </nova:port>
Nov 29 07:29:29 user nova-compute[75373]:       </nova:ports>
Nov 29 07:29:29 user nova-compute[75373]:     </nova:instance>
Nov 29 07:29:29 user nova-compute[75373]:   </metadata>
Nov 29 07:29:29 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:29:29 user nova-compute[75373]:     <system>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="serial">ae9d3db8-d3ac-4cfc-81ac-e585aeb53338</entry>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="uuid">ae9d3db8-d3ac-4cfc-81ac-e585aeb53338</entry>
Nov 29 07:29:29 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:29:29 user nova-compute[75373]:     </system>
Nov 29 07:29:29 user nova-compute[75373]:   </sysinfo>
Nov 29 07:29:29 user nova-compute[75373]:   <os>
Nov 29 07:29:29 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:29:29 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:29:29 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:29:29 user nova-compute[75373]:   </os>
Nov 29 07:29:29 user nova-compute[75373]:   <features>
Nov 29 07:29:29 user nova-compute[75373]:     <acpi/>
Nov 29 07:29:29 user nova-compute[75373]:     <apic/>
Nov 29 07:29:29 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:29:29 user nova-compute[75373]:   </features>
Nov 29 07:29:29 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:29:29 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:29:29 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:29:29 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:29:29 user nova-compute[75373]:   </clock>
Nov 29 07:29:29 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:29:29 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:29:29 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:29:29 user nova-compute[75373]:   </cpu>
Nov 29 07:29:29 user nova-compute[75373]:   <devices>
Nov 29 07:29:29 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:29:29 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:29:29 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk"/>
Nov 29 07:29:29 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:29:29 user nova-compute[75373]:     </disk>
Nov 29 07:29:29 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:29:29 user nova-compute[75373]:       <mac address="fa:16:3e:c6:97:c3"/>
Nov 29 07:29:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:29 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:29:29 user nova-compute[75373]:       <target dev="tapf91b4d14-39"/>
Nov 29 07:29:29 user nova-compute[75373]:     </interface>
Nov 29 07:29:29 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:29:29 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/console.log" append="off"/>
Nov 29 07:29:29 user nova-compute[75373]:     </serial>
Nov 29 07:29:29 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:29:29 user nova-compute[75373]:     <video>
Nov 29 07:29:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:29 user nova-compute[75373]:     </video>
Nov 29 07:29:29 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:29:29 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:29:29 user nova-compute[75373]:     </rng>
Nov 29 07:29:29 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:29:29 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:29:29 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:29:29 user nova-compute[75373]:     </memballoon>
Nov 29 07:29:29 user nova-compute[75373]:   </devices>
Nov 29 07:29:29 user nova-compute[75373]: </domain>
Nov 29 07:29:29 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1546011437',display_name='tempest-TestStampPattern-server-1546011437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1546011437',id=26,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-scmgrcln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:27Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=ae9d3db8-d3ac-4cfc-81ac-e585aeb53338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG os_vif [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9da7363-e13c-5ea0-8ca6-5e97dda000d7', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91b4d14-39, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf91b4d14-39, col_values=(('qos', UUID('15838288-17dc-4b09-a95f-ef396242c62d')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf91b4d14-39, col_values=(('external_ids', {'iface-id': 'f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:97:c3', 'vm-uuid': 'ae9d3db8-d3ac-4cfc-81ac-e585aeb53338'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:29 user nova-compute[75373]: INFO os_vif [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39')
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No VIF found with MAC fa:16:3e:c6:97:c3, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updated VIF entry in instance network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12208386-b8b7-417b-b34b-258892e8aa08 req-84439aa2-4594-4bbe-85f9-89edf33c74a9 service nova] Releasing lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] No waiting events found dispatching network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:31 user nova-compute[75373]: WARNING nova.compute.manager [req-bd108df8-2610-4d72-8f6c-d7d55b2686b2 req-cf35baf7-b226-4689-aa22-91e7198c1d0e service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received unexpected event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a for instance with vm_state building and task_state spawning.
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:29:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Instance spawned successfully.
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] No waiting events found dispatching network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:33 user nova-compute[75373]: WARNING nova.compute.manager [req-f1762d63-de52-475e-83e1-37c946eb775e req-645c87f6-7d16-4657-889f-a4b7e8e7d289 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received unexpected event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a for instance with vm_state building and task_state spawning.
Nov 29 07:29:33 user nova-compute[75373]: INFO nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:29:33 user nova-compute[75373]: INFO nova.compute.manager [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Took 7.34 seconds to build instance.
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-615e9871-e379-4a68-bae4-fdf38664e243 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.453s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:33 user nova-compute[75373]: INFO nova.compute.manager [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Terminating instance
Nov 29 07:29:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:29:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-unplugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] No waiting events found dispatching network-vif-unplugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-5c8aadc1-77bf-40cd-a229-666c329a006b req-48716a1b-69dc-4c92-999a-1d96797bf998 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-unplugged-c620401f-da47-4341-9f82-c97ceea48d9e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Instance destroyed successfully.
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lazy-loading 'resources' on Instance uuid 7730c34d-5c8b-4f03-9a77-b24ce6244605 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-888486235',display_name='tempest-ServersNegativeTestJSON-server-888486235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-888486235',id=2,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4071c6738f4509a906b090b5ffdb84',ramdisk_id='',reservation_id='r-rpb71aar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1656759200',owner_user_name='tempest-ServersNegativeTestJSON-1656759200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:06Z,user_data=None,user_id='1bc76bca5efd4f1aaf1250f9d63d1859',uuid=7730c34d-5c8b-4f03-9a77-b24ce6244605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converting VIF {"id": "c620401f-da47-4341-9f82-c97ceea48d9e", "address": "fa:16:3e:4a:87:e8", "network": {"id": "e8204806-032b-43a6-9de2-005fbb335909", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1322244684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4071c6738f4509a906b090b5ffdb84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc620401f-da", "ovs_interfaceid": "c620401f-da47-4341-9f82-c97ceea48d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG os_vif [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc620401f-da, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78bf913a-cfb7-4bb3-a369-862eb5b1dc67) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:34 user nova-compute[75373]: INFO os_vif [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=c620401f-da47-4341-9f82-c97ceea48d9e,network=Network(e8204806-032b-43a6-9de2-005fbb335909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc620401f-da')
Nov 29 07:29:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Deleting instance files /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605_del
Nov 29 07:29:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Deletion of /opt/stack/data/nova/instances/7730c34d-5c8b-4f03-9a77-b24ce6244605_del complete
Nov 29 07:29:34 user nova-compute[75373]: INFO nova.compute.manager [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 07:29:34 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:29:34 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-8423e435-ff1a-4acd-a2f5-f940947f2f16 req-c4b60aae-478f-4ed2-b7fc-9ac24ad6a378 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-deleted-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:35 user nova-compute[75373]: INFO nova.compute.manager [req-8423e435-ff1a-4acd-a2f5-f940947f2f16 req-c4b60aae-478f-4ed2-b7fc-9ac24ad6a378 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Neutron deleted interface c620401f-da47-4341-9f82-c97ceea48d9e; detaching it from the instance and deleting it from the info cache
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.network.neutron [req-8423e435-ff1a-4acd-a2f5-f940947f2f16 req-c4b60aae-478f-4ed2-b7fc-9ac24ad6a378 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:35 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Took 0.71 seconds to deallocate network for instance.
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-8423e435-ff1a-4acd-a2f5-f940947f2f16 req-c4b60aae-478f-4ed2-b7fc-9ac24ad6a378 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Detach interface failed, port_id=c620401f-da47-4341-9f82-c97ceea48d9e, reason: Instance 7730c34d-5c8b-4f03-9a77-b24ce6244605 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:29:35 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:36 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Deleted allocations for instance 7730c34d-5c8b-4f03-9a77-b24ce6244605
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc79ddb9-6f58-47c4-8481-1720ea6577b7 tempest-ServersNegativeTestJSON-1656759200 tempest-ServersNegativeTestJSON-1656759200-project-member] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] Acquiring lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] Lock "7730c34d-5c8b-4f03-9a77-b24ce6244605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] No waiting events found dispatching network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:36 user nova-compute[75373]: WARNING nova.compute.manager [req-d107b48c-0896-4116-ac47-caa466b3f700 req-a7849f0f-65f2-438d-9e72-449ce25ba672 service nova] [instance: 7730c34d-5c8b-4f03-9a77-b24ce6244605] Received unexpected event network-vif-plugged-c620401f-da47-4341-9f82-c97ceea48d9e for instance with vm_state deleted and task_state None.
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:29:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:29:37 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:29:42 user nova-compute[75373]: INFO nova.compute.manager [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Rescuing
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG nova.network.neutron [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:29:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.network.neutron [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:43 user nova-compute[75373]: WARNING nova.compute.manager [req-9847025e-46c5-4a3a-b7ff-06672ae6047e req-26f9bd3f-909a-4756-83d1-441b47af0d77 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state rescuing.
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance destroyed successfully.
Nov 29 07:29:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Attempting a stable device rescue
Nov 29 07:29:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:29:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Creating image(s)
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 1.068s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG nova.virt.images [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] b97b529e-a712-49bb-a8db-65fa2ae3f263 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.part /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:45 user nova-compute[75373]: WARNING nova.compute.manager [req-16dcba1c-a7be-4148-8c71-8928cbfbd33c req-425f643c-77db-4f10-be03-7aa377c64029 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state rescuing.
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.part /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.converted" returned: 0 in 0.308s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.804s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b,backing_fmt=raw /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b,backing_fmt=raw /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue" returned: 0 in 0.053s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "74c1725423b9ada79d72b4a7fb399dfa4cf9a92b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'migration_context' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<5de96a96-0082-43fa-a18d-be40468c6c8d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start _get_guest_xml network_info=[{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:9e:33:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b97b529e-a712-49bb-a8db-65fa2ae3f263', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5de96a96-0082-43fa-a18d-be40468c6c8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e082533d-6115-4edc-844b-b6a8a167cc43', 'serial': 'e082533d-6115-4edc-844b-b6a8a167cc43'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'bde94705-2e6e-46cf-8dba-ec21e830926f', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<5de96a96-0082-43fa-a18d-be40468c6c8d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'numa_topology' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<5de96a96-0082-43fa-a18d-be40468c6c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:46 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<5de96a96-0082-43fa-a18d-be40468c6c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:29:46 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:29:46 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:29:46 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda783f-313d-40fc-bc4e-84f695a61177]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XAeajImZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 07:29:46 user nova-compute[75373]: node.name = iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:29:46 user nova-compute[75373]: node.tpgt = -1
Nov 29 07:29:46 user nova-compute[75373]: node.startup = automatic
Nov 29 07:29:46 user nova-compute[75373]: node.leading_login = No
Nov 29 07:29:46 user nova-compute[75373]: iface.iscsi_ifacename = default
Nov 29 07:29:46 user nova-compute[75373]: iface.net_ifacename = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.ipaddress = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.prefix_len = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.hwaddress = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.transport_name = tcp
Nov 29 07:29:46 user nova-compute[75373]: iface.initiatorname = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.vlan_id = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.vlan_priority = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.vlan_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.iface_num = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.mtu = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.port = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.bootproto = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.subnet_mask = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.gateway = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_alt_client_id = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_dns = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_learn_iqn = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_vendor_id_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_vendor_id = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.dhcp_slp_da = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.fragmentation = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.gratuitous_arp = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.incoming_forwarding = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.tos_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.tos = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.ttl = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.delayed_ack = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.tcp_nagle = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.tcp_wsf_state = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.tcp_wsf = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.tcp_timer_scale = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.tcp_timestamp = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.redirect = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.def_task_mgmt_timeout = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.header_digest = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.data_digest = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.immediate_data = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.initial_r2t = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.data_seq_inorder = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.data_pdu_inorder = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.erl = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.max_receive_data_len = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.first_burst_len = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.max_outstanding_r2t = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.max_burst_len = 0
Nov 29 07:29:46 user nova-compute[75373]: iface.chap_auth = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.bidi_chap = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.strict_login_compliance = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.discovery_auth = <empty>
Nov 29 07:29:46 user nova-compute[75373]: iface.discovery_logout = <empty>
Nov 29 07:29:46 user nova-compute[75373]: node.discovery_address = <empty>
Nov 29 07:29:46 user nova-compute[75373]: node.discovery_port = 0
Nov 29 07:29:46 user nova-compute[75373]: node.discovery_type = static
Nov 29 07:29:46 user nova-compute[75373]: node.session.initial_cmdsn = 0
Nov 29 07:29:46 user nova-compute[75373]: node.session.initial_login_retry_max = 8
Nov 29 07:29:46 user nova-compute[75373]: node.session.xmit_thread_priority = -20
Nov 29 07:29:46 user nova-compute[75373]: node.session.cmds_max = 128
Nov 29 07:29:46 user nova-compute[75373]: node.session.queue_depth = 32
Nov 29 07:29:46 user nova-compute[75373]: node.session.nr_sessions = 1
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.authmethod = CHAP
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.username = XAeajImZ
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.password = ***
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.username_in = <empty>
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.password_in = <empty>
Nov 29 07:29:46 user nova-compute[75373]: node.session.auth.chap_algs = MD5
Nov 29 07:29:46 user nova-compute[75373]: node.session.timeo.replacement_timeout = 120
Nov 29 07:29:46 user nova-compute[75373]: node.session.err_timeo.abort_timeout = 15
Nov 29 07:29:46 user nova-compute[75373]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 07:29:46 user nova-compute[75373]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 07:29:46 user nova-compute[75373]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.FastAbort = Yes
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.InitialR2T = No
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.ImmediateData = Yes
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.MaxConnections = 1
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 07:29:46 user nova-compute[75373]: node.session.iscsi.ERL = 0
Nov 29 07:29:46 user nova-compute[75373]: node.session.scan = manual
Nov 29 07:29:46 user nova-compute[75373]: node.session.reopen_max = 0
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].address = 172.16.0.220
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].port = 3260
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].startup = manual
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].tcp.window_size = 524288
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].tcp.type_of_service = 0
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].timeo.logout_timeout = 15
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].timeo.login_timeout = 15
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].timeo.auth_timeout = 45
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.DataDigest = None
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.IFMarker = No
Nov 29 07:29:46 user nova-compute[75373]: node.conn[0].iscsi.OFMarker = No
Nov 29 07:29:46 user nova-compute[75373]: # END RECORD
Nov 29 07:29:46 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab3f17-43ff-46a8-8cb6-c54d147baa0a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ad2ca5-dd9e-45fc-9d2d-b0ce72deb54d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAeajImZ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XAeajImZ" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0706ec93-9614-4d40-962d-06d837ae9ed8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XAeajImZ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c6bfcb-8315-461c-bd13-71bd4448940e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[670eebd9-484f-4f8f-88ac-d539b1dc0da8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:29:46 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:29:46 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] HCTL ('35', '0', '0', 0) found on session 20 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb4d26-34d0-4670-89a5-b7f2c5a730b5]: (4, ('0 0 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching for a device in session 20 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.211s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== connect_volume: return (212ms) {'type': 'block', 'scsi_wwn': '23232383335393337', 'path': '/dev/sdd'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232383335393337', 'path': '/dev/sdd'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1623388813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1623388813',id=21,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-8hirr1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:28:14Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=5de96a96-0082-43fa-a18d-be40468c6c8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:9e:33:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:9e:33:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.objects.base [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<5de96a96-0082-43fa-a18d-be40468c6c8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:29:46 user nova-compute[75373]:   <uuid>5de96a96-0082-43fa-a18d-be40468c6c8d</uuid>
Nov 29 07:29:46 user nova-compute[75373]:   <name>instance-00000015</name>
Nov 29 07:29:46 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:29:46 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:29:46 user nova-compute[75373]:   <metadata>
Nov 29 07:29:46 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:29:46 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1623388813</nova:name>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:29:46</nova:creationTime>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:29:46 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:29:46 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:owner>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:29:46 user nova-compute[75373]:       </nova:owner>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:29:46 user nova-compute[75373]:       <nova:ports>
Nov 29 07:29:46 user nova-compute[75373]:         <nova:port uuid="1308faaa-a0a4-43fe-9a15-d8ba09ad85bd">
Nov 29 07:29:46 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 07:29:46 user nova-compute[75373]:         </nova:port>
Nov 29 07:29:46 user nova-compute[75373]:       </nova:ports>
Nov 29 07:29:46 user nova-compute[75373]:     </nova:instance>
Nov 29 07:29:46 user nova-compute[75373]:   </metadata>
Nov 29 07:29:46 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:29:46 user nova-compute[75373]:     <system>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="serial">5de96a96-0082-43fa-a18d-be40468c6c8d</entry>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="uuid">5de96a96-0082-43fa-a18d-be40468c6c8d</entry>
Nov 29 07:29:46 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:29:46 user nova-compute[75373]:     </system>
Nov 29 07:29:46 user nova-compute[75373]:   </sysinfo>
Nov 29 07:29:46 user nova-compute[75373]:   <os>
Nov 29 07:29:46 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:29:46 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:29:46 user nova-compute[75373]:   </os>
Nov 29 07:29:46 user nova-compute[75373]:   <features>
Nov 29 07:29:46 user nova-compute[75373]:     <acpi/>
Nov 29 07:29:46 user nova-compute[75373]:     <apic/>
Nov 29 07:29:46 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:29:46 user nova-compute[75373]:   </features>
Nov 29 07:29:46 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:29:46 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:29:46 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:29:46 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:29:46 user nova-compute[75373]:   </clock>
Nov 29 07:29:46 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:29:46 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:29:46 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:29:46 user nova-compute[75373]:   </cpu>
Nov 29 07:29:46 user nova-compute[75373]:   <devices>
Nov 29 07:29:46 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:29:46 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:29:46 user nova-compute[75373]:       <source dev="/dev/sdd"/>
Nov 29 07:29:46 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:29:46 user nova-compute[75373]:       <serial>e082533d-6115-4edc-844b-b6a8a167cc43</serial>
Nov 29 07:29:46 user nova-compute[75373]:     </disk>
Nov 29 07:29:46 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:29:46 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:29:46 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue"/>
Nov 29 07:29:46 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:29:46 user nova-compute[75373]:       <boot order="1"/>
Nov 29 07:29:46 user nova-compute[75373]:     </disk>
Nov 29 07:29:46 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:29:46 user nova-compute[75373]:       <mac address="fa:16:3e:9e:33:3a"/>
Nov 29 07:29:46 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:46 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:29:46 user nova-compute[75373]:       <target dev="tap1308faaa-a0"/>
Nov 29 07:29:46 user nova-compute[75373]:     </interface>
Nov 29 07:29:46 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:29:46 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/console.log" append="off"/>
Nov 29 07:29:46 user nova-compute[75373]:     </serial>
Nov 29 07:29:46 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:29:46 user nova-compute[75373]:     <video>
Nov 29 07:29:46 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:29:46 user nova-compute[75373]:     </video>
Nov 29 07:29:46 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:29:46 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:29:46 user nova-compute[75373]:     </rng>
Nov 29 07:29:46 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:29:46 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:29:46 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:29:46 user nova-compute[75373]:     </memballoon>
Nov 29 07:29:46 user nova-compute[75373]:   </devices>
Nov 29 07:29:46 user nova-compute[75373]: </domain>
Nov 29 07:29:46 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:29:46 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance destroyed successfully.
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:29:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:9e:33:3a, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:48 user nova-compute[75373]: WARNING nova.compute.manager [req-66f9c2c8-eb81-4b37-ba12-d107d7f267a2 req-b556a093-6a60-4690-84d5-b5746512c4ad service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state rescuing.
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-changed-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Refreshing instance network info cache due to event network-changed-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] Acquiring lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] Acquired lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.network.neutron [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Refreshing network info cache for port 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:50 user nova-compute[75373]: WARNING nova.compute.manager [req-a87cebad-f4b6-4598-a300-f0111c923dff req-ed32dd3c-e3f3-488d-834a-cc229ccc07c9 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state active and task_state rescuing.
Nov 29 07:29:50 user nova-compute[75373]: DEBUG nova.compute.manager [None req-aa5cb643-2fa8-4c34-8a14-393d78b573f4 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:29:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=25.24359893798828GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:51 user nova-compute[75373]: INFO nova.compute.manager [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Terminating instance
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7aa8bf58-5fb6-448d-8543-b703025acb36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5f526a92-a0db-4cde-9d68-765ff3d11470 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updated VIF entry in instance network info cache for port 051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updating instance_info_cache with network_info: [{"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-19e3a80f-9fa1-4ab8-aa98-b311d9a48b26 req-e891882f-cb71-4f20-84d9-c4b91856dcfa service nova] Releasing lock "refresh_cache-7aa8bf58-5fb6-448d-8543-b703025acb36" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-unplugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] No waiting events found dispatching network-vif-unplugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-unplugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Acquiring lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] No waiting events found dispatching network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:29:51 user nova-compute[75373]: WARNING nova.compute.manager [req-83ce2572-c627-4000-b57e-1d06dcfc13b6 req-1baf16ef-9dba-437a-abfd-05b2f84c1146 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received unexpected event network-vif-plugged-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 for instance with vm_state active and task_state deleting.
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Instance destroyed successfully.
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'resources' on Instance uuid 7aa8bf58-5fb6-448d-8543-b703025acb36 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63605660',display_name='tempest-AttachVolumeNegativeTest-server-63605660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63605660',id=22,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUFdQH528/DMU+napu32zzQmWqmRe2O5d/9JfHxglUrCHMRrIwwJTnfSozOHoXdpEW/7Wh0ZDltF3TxbubjjeyyuOOJmaHet/hCxKmN3mWfiK+pBqn3VTjMiqstS2giKg==',key_name='tempest-keypair-117331830',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-u4cqb05l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=7aa8bf58-5fb6-448d-8543-b703025acb36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "address": "fa:16:3e:23:6e:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051718a5-99", "ovs_interfaceid": "051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG os_vif [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051718a5-99, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99d7f41f-4fbf-473d-8ca8-73fbc9776ab3) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:51 user nova-compute[75373]: INFO os_vif [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:a1,bridge_name='br-int',has_traffic_filtering=True,id=051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051718a5-99')
Nov 29 07:29:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Deleting instance files /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36_del
Nov 29 07:29:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Deletion of /opt/stack/data/nova/instances/7aa8bf58-5fb6-448d-8543-b703025acb36_del complete
Nov 29 07:29:51 user nova-compute[75373]: INFO nova.compute.manager [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 07:29:51 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:29:51 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:52 user nova-compute[75373]: INFO nova.compute.manager [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Unshelving
Nov 29 07:29:52 user nova-compute[75373]: INFO nova.virt.block_device [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Booting with volume 4564804a-aaef-40f8-8b84-b995ab86e821 at /dev/vdc
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.utils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f4c35-9562-4c2a-8e7a-b14ec7a6ee93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a9a81-6834-4b24-877e-bd703af63d5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9549443-16e6-400c-8ff9-3e8f074b223e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[843c5c46-2e6a-4462-9c80-baed5a1bcce8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:29:52 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[35160109-5168-4857-bad2-039422e11f2f]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG os_brick.utils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating existing volume attachment record: ba4e5413-96d3-419c-bb75-5d6f137aa432 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:52 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Took 0.92 seconds to deallocate network for instance.
Nov 29 07:29:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-9b49ccdf-d56c-4ef1-b0f1-8060576cf409 req-4a9dbfbd-ae8e-4ceb-9e89-485d742a95d9 service nova] [instance: 7aa8bf58-5fb6-448d-8543-b703025acb36] Received event network-vif-deleted-051718a5-99ab-4f91-8ee8-fbb5ca5fe5e0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:29:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:29:53 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:29:53 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:29:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:53 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Deleted allocations for instance 7aa8bf58-5fb6-448d-8543-b703025acb36
Nov 29 07:29:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f23d063d-98bd-40bb-b80c-46b5ebbcb913 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "7aa8bf58-5fb6-448d-8543-b703025acb36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:29:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:29:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-changed-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:29:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing instance network info cache due to event network-changed-a6a93a49-9645-4a99-97ba-167b6f993a61. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:29:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] Acquiring lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:29:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] Acquired lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:29:58 user nova-compute[75373]: DEBUG nova.network.neutron [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Refreshing network info cache for port a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:29:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updated VIF entry in instance network info cache for port a6a93a49-9645-4a99-97ba-167b6f993a61. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:29:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [{"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:29:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1133e422-5bd0-4c3b-bc19-883025948f67 req-9d32af23-6926-4a4e-bae9-ab6eabad82e7 service nova] Releasing lock "refresh_cache-5f526a92-a0db-4cde-9d68-765ff3d11470" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_requests' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'numa_topology' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:00 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:30:00 user nova-compute[75373]: INFO nova.compute.claims [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Claim successful on node user
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:01 user nova-compute[75373]: INFO nova.compute.manager [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Terminating instance
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-bb96baca-b324-4ef6-87ff-53d4d5955f48 req-9443b11c-7a75-464c-afb0-d567a8f683ed service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:01 user nova-compute[75373]: INFO nova.network.neutron [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-e241bd9d-0ad8-42a0-890d-f59ec25cdd99 req-d38ee030-852e-4119-9651-fb1cc06e0258 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-a6a93a49-9645-4a99-97ba-167b6f993a61 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-0ba4d9f9-d02f-4f99-9282-2b99457d94b5 req-6eae33c3-6a1d-47a6-92fa-36e09a3d53ec service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Instance destroyed successfully.
Nov 29 07:30:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lazy-loading 'resources' on Instance uuid 5f526a92-a0db-4cde-9d68-765ff3d11470 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "a6a93a49-9645-4a99-97ba-167b6f993a61", "address": "fa:16:3e:e4:dc:ef", "network": {"id": "1706ad04-99cd-475d-b202-6bd1fef3347a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-38641301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6a93a49-96", "ovs_interfaceid": "a6a93a49-9645-4a99-97ba-167b6f993a61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6a93a49-96, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af36f4ff-a843-416d-b565-d3a14b0c6ccb) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:dc:ef,bridge_name='br-int',has_traffic_filtering=True,id=a6a93a49-9645-4a99-97ba-167b6f993a61,network=Network(1706ad04-99cd-475d-b202-6bd1fef3347a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6a93a49-96')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d44359-61, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da4ad92f-d6c0-4d2a-8468-8138daa71b7e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=b7d44359-61ea-4665-972f-95875c27f2a2,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d44359-61')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07013bc2-11, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0abbb099-5464-47ad-bea9-3b3d2850c385) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:da:0a,bridge_name='br-int',has_traffic_filtering=True,id=07013bc2-1169-4d62-a22e-7ddbcd09fef0,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap07013bc2-11')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap939a6aeb-81, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33bad2da-d6bb-4fb3-8c3d-7852c6d3b419) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:35:0e,bridge_name='br-int',has_traffic_filtering=True,id=939a6aeb-8131-4f39-944c-474c7af2b8d5,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap939a6aeb-81')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3e4d36b-58, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=871d0ff8-9c52-4e29-a60c-ddc2a7c12cc7) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7e:c2,bridge_name='br-int',has_traffic_filtering=True,id=e3e4d36b-5878-4a3a-b755-50ca18b13232,network=Network(8550ca70-3eb5-4ade-8505-0a3774054616),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e4d36b-58')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc0e3e1-ee, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=880ac758-943f-4ba6-b0d8-aa90d80ae667) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:eb:5f,bridge_name='br-int',has_traffic_filtering=True,id=ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc0e3e1-ee')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T07:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1068111306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1068111306',id=23,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6Lxvdsvqv4FC73F4hCE7RuzxBnEV9hg225es8qdBxxusu0ixYr7N3LygTo6gWAdyHNZZb3mU9S0TQK2g8Ls5a/XS4O+7mN7SJMp7X0ehyIlmV8XriRveaskb9kQ+4HQ==',key_name='tempest-keypair-902557210',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cede33af47b4deb831b8c57d56815b5',ramdisk_id='',reservation_id='r-u4da0pf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1458404939',owner_user_name='tempest-TaggedBootDevicesTest_v242-1458404939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a60fe94049864638be7c1d0f38dad82f',uuid=5f526a92-a0db-4cde-9d68-765ff3d11470,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converting VIF {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ea65cae-1b, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02a37086-b847-483d-a312-9e91663e9d41) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:03 user nova-compute[75373]: INFO os_vif [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:d7:46,bridge_name='br-int',has_traffic_filtering=True,id=7ea65cae-1b64-4669-aaab-da98da12b585,network=Network(287aa5ac-1e2a-48c9-b9b8-0726e76393ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea65cae-1b')
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHbpdLqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18283a1-11c7-4858-8180-ae9032e18ee0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]: iSNS:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]: STATIC:
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: FIRMWARE:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:30:03 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:30:03 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3901b-ce52-49a4-88b1-5015c9e613ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fd6a87-4212-48b3-8918-061c72d2857f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b089331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed479043-9ee0-48c1-8517-1413bc9920d9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b55939-2aeb-41a2-8627-97ebd58f8217]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[402e7073-52e0-40d0-a547-457cb7328447]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c8ca5-2181-49b0-b200-d56556ca3e0c]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be0cd9-7e2c-4817-b7b2-c0ea2ba99347]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc71470-3afb-4841-834d-6a4917afe850]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260]
Nov 29 07:30:03 user nova-compute[75373]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180, portal: 172.16.0.220,3260] successful.
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-07013bc2-1169-4d62-a22e-7ddbcd09fef0 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-7ea65cae-1b64-4669-aaab-da98da12b585 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-7ea65cae-1b64-4669-aaab-da98da12b585 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-changed-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Refreshing instance network info cache due to event network-changed-68cb76a9-e30c-4470-97d6-9e028490a7fe. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Refreshing network info cache for port 68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e88e08d5-af7a-490c-abb1-09b9b7b5c180 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e249c08-8bcd-441e-8929-6c76703df12f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== disconnect_volume: return (333ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'disDAMTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0d509-f7d7-47ff-887b-2a073cc149c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]: iSNS:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]: STATIC:
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:30:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:03 user nova-compute[75373]: FIRMWARE:
Nov 29 07:30:03 user nova-compute[75373]: No targets found.
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:30:03 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:30:03 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[17766d9d-e48a-4081-8553-5bfc8a3b209a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e0235-351f-4671-b87e-45d62acb8d4f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:03 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0031e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9'): ({'sdf'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Removing single pathed devices sdf {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b777b-ee73-4153-8d26-f76b57a2cbe4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-a6a93a49-9645-4a99-97ba-167b6f993a61 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-b7d44359-61ea-4665-972f-95875c27f2a2 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-b7d44359-61ea-4665-972f-95875c27f2a2 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing instance network info cache due to event network-changed-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[662900b6-65e7-4886-a7e6-51f30c36ac2d]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-939a6aeb-8131-4f39-944c-474c7af2b8d5 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-unplugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-unplugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:03 user nova-compute[75373]: WARNING nova.compute.manager [req-b5cd1a29-b527-4e19-9140-ae16a4117670 req-c7113ee1-4633-4354-8f81-1fc767097c65 service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-e3e4d36b-5878-4a3a-b755-50ca18b13232 for instance with vm_state active and task_state deleting.
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Flushing IO for device /dev/sdf {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb3ab5-60df-49ff-88bd-7a895a1b743f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097ea58-0ad0-4d45-8116-8d83fce37c5c]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd29a0-064d-46f9-98f8-d8a0745bc749]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491a36f-1dab-4124-9a59-c6bcc7debc0b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260]
Nov 29 07:30:04 user nova-compute[75373]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9, portal: 172.16.0.220,3260] successful.
Nov 29 07:30:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ad6c50d-f27b-44dd-8928-91091d27dfc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f24ac5-2459-48f3-afc5-531f64651800]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== disconnect_volume: return (363ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFnPBjtQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:30:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59aaa5-5b06-4def-803c-5fa0d02d381d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:30:04 user nova-compute[75373]: No targets found.
Nov 29 07:30:04 user nova-compute[75373]: iSNS:
Nov 29 07:30:04 user nova-compute[75373]: No targets found.
Nov 29 07:30:04 user nova-compute[75373]: STATIC:
Nov 29 07:30:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:30:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:30:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd
Nov 29 07:30:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:30:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:30:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:30:04 user nova-compute[75373]: FIRMWARE:
Nov 29 07:30:04 user nova-compute[75373]: No targets found.
Nov 29 07:30:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:30:04 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:30:04 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a362e96-0c9f-4859-bb78-ba72d7dfde30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c745af-caea-4b5f-9642-bfb726f96a4d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd (non-flash)
Nov 29 07:30:04 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae030d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd'): ({'sdg'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Removing single pathed devices sdg {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updated VIF entry in instance network info cache for port 68cb76a9-e30c-4470-97d6-9e028490a7fe. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3a9fb8b9-e247-4971-8087-1dffec24184d req-2833b153-969f-466f-b68f-832a3574fb46 service nova] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[36461834-3df2-4359-b8b8-ef8996f4cac0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d855c6e-2141-42cc-ba1d-9fd5cb50b95d]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Flushing IO for device /dev/sdg {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a0a62-d1f9-4b15-900e-fea7e73f8629]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ed5ce-e4ec-48a9-8249-10b01d766f38]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:30:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Creating image(s)
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquired lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Refreshing network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<fb883135-2995-4186-8251-42cae4bd57c3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03ff84-c545-4db9-8f74-76baa1f3f675]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d3102-7153-415d-9813-67167c2e13ef]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260]
Nov 29 07:30:04 user nova-compute[75373]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd, portal: 172.16.0.220,3260] successful.
Nov 29 07:30:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97a3bf4f-7355-407c-81ad-00c9e756c4bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9818d48-6de8-46ce-8378-68dfda602e24]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] <== disconnect_volume: return (327ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:30:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:30:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Deleting instance files /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470_del
Nov 29 07:30:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Deletion of /opt/stack/data/nova/instances/5f526a92-a0db-4cde-9d68-765ff3d11470_del complete
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:05 user nova-compute[75373]: INFO nova.compute.manager [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Took 4.45 seconds to destroy the instance on the hypervisor.
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.virt.images [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] 7b9ca56a-7536-438b-8b2e-679baf270c0d was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.part /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updated VIF entry in instance network info cache for port bcb689a0-25f4-44c5-97a1-deb9e62d6ed8. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.part /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.converted" returned: 0 in 0.226s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Releasing lock "refresh_cache-fb883135-2995-4186-8251-42cae4bd57c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Acquiring lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] No waiting events found dispatching network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:06 user nova-compute[75373]: WARNING nova.compute.manager [req-d721ca4f-b980-411a-8a41-23f12ac5db10 req-fdbb25b0-394d-40d4-8b22-3270d2f89faa service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received unexpected event network-vif-plugged-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 for instance with vm_state active and task_state deleting.
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.794s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121,backing_fmt=raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121,backing_fmt=raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk 1073741824" returned: 0 in 0.045s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "c2ef5fe7c8470043de97829fdf1a3a0a26e00121" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'migration_context' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG nova.objects.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<fb883135-2995-4186-8251-42cae4bd57c3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:30:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Rebasing disk image.
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 -F raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-b660e550-ff24-4c3d-9298-73ab0f5c3f34 req-552a7ae0-2c51-45f7-a7c9-053026b25f4d service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-deleted-a6a93a49-9645-4a99-97ba-167b6f993a61 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:07 user nova-compute[75373]: INFO nova.compute.manager [req-b660e550-ff24-4c3d-9298-73ab0f5c3f34 req-552a7ae0-2c51-45f7-a7c9-053026b25f4d service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Neutron deleted interface a6a93a49-9645-4a99-97ba-167b6f993a61; detaching it from the instance and deleting it from the info cache
Nov 29 07:30:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-b660e550-ff24-4c3d-9298-73ab0f5c3f34 req-552a7ae0-2c51-45f7-a7c9-053026b25f4d service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [{"id": "b7d44359-61ea-4665-972f-95875c27f2a2", "address": "fa:16:3e:28:ab:6e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d44359-61", "ovs_interfaceid": "b7d44359-61ea-4665-972f-95875c27f2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "address": "fa:16:3e:49:da:0a", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.21", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07013bc2-11", "ovs_interfaceid": "07013bc2-1169-4d62-a22e-7ddbcd09fef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "address": "fa:16:3e:2f:35:0e", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap939a6aeb-81", "ovs_interfaceid": "939a6aeb-8131-4f39-944c-474c7af2b8d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "address": "fa:16:3e:b4:7e:c2", "network": {"id": "8550ca70-3eb5-4ade-8505-0a3774054616", "bridge": "br-int", "label": "tempest-device-tagging-net1-1296345906", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e4d36b-58", "ovs_interfaceid": "e3e4d36b-5878-4a3a-b755-50ca18b13232", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "address": "fa:16:3e:60:eb:5f", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc0e3e1-ee", "ovs_interfaceid": "ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ea65cae-1b64-4669-aaab-da98da12b585", "address": "fa:16:3e:08:d7:46", "network": {"id": "287aa5ac-1e2a-48c9-b9b8-0726e76393ba", "bridge": "br-int", "label": "tempest-device-tagging-net2-39327962", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9cede33af47b4deb831b8c57d56815b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea65cae-1b", "ovs_interfaceid": "7ea65cae-1b64-4669-aaab-da98da12b585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-b660e550-ff24-4c3d-9298-73ab0f5c3f34 req-552a7ae0-2c51-45f7-a7c9-053026b25f4d service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Detach interface failed, port_id=a6a93a49-9645-4a99-97ba-167b6f993a61, reason: Instance 5f526a92-a0db-4cde-9d68-765ff3d11470 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:08 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Took 3.17 seconds to deallocate network for instance.
Nov 29 07:30:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 -F raw /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk" returned: 0 in 1.966s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Ensure instance console log exists: /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start _get_guest_xml network_info=[{"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8f58afd71bab55602880be7bc5abb5f2',container_format='bare',created_at=2023-11-29T07:27:59Z,direct_url=<?>,disk_format='qcow2',id=7b9ca56a-7536-438b-8b2e-679baf270c0d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-603230549-shelved',owner='c7fb2c66f2ee4df08d54238965f90bc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:28:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBivkRZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fb883135-2995-4186-8251-42cae4bd57c3', 'attached_at': '', 'detached_at': '', 'volume_id': '4564804a-aaef-40f8-8b84-b995ab86e821', 'serial': '4564804a-aaef-40f8-8b84-b995ab86e821'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'ba4e5413-96d3-419c-bb75-5d6f137aa432', 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:30:08 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:30:08 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8f58afd71bab55602880be7bc5abb5f2',container_format='bare',created_at=2023-11-29T07:27:59Z,direct_url=<?>,disk_format='qcow2',id=7b9ca56a-7536-438b-8b2e-679baf270c0d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-603230549-shelved',owner='c7fb2c66f2ee4df08d54238965f90bc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:28:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:08 user nova-compute[75373]: DEBUG nova.objects.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<fb883135-2995-4186-8251-42cae4bd57c3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBivkRZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:30:09 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:30:09 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:30:09 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18661d2-3da8-4e64-8a68-344ccb484268]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:30:09 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e987fa3-b120-43d0-ba70-0b15a303e2d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821] added
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[60756a18-f31b-4ee2-956d-cea70f2fe0ef]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bae476-62ac-4660-8f61-18e4d0acff6f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBivkRZq {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EBivkRZq" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18846a8-1d9c-4dcf-93c7-c6ab239f2b90]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EBivkRZq'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[115512be-ce44-4b76-94a3-f86cdc50b9fa]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbe1a3d-dc90-496c-b793-6a6a366dbf13]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280feb0-d182-4a62-ae23-71842c559c56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260]
Nov 29 07:30:09 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260] successful.
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9584aba7-9d2a-435e-a6da-69c1ef02a494]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d3b5a0-7322-4083-a5ca-723108ef9c83]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:30:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf12d9-e3f3-441b-b090-cb2e96b540b7]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBivkRZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-eeadcbf8-9e73-4267-b23c-9c5a12918966 req-01b52ee2-d149-4daa-b65f-05075ce4c50b service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-deleted-ddc0e3e1-ee4c-45d8-8f10-87b9e86e0ff3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-eeadcbf8-9e73-4267-b23c-9c5a12918966 req-01b52ee2-d149-4daa-b65f-05075ce4c50b service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-deleted-e3e4d36b-5878-4a3a-b755-50ca18b13232 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-eeadcbf8-9e73-4267-b23c-9c5a12918966 req-01b52ee2-d149-4daa-b65f-05075ce4c50b service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-deleted-939a6aeb-8131-4f39-944c-474c7af2b8d5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-eeadcbf8-9e73-4267-b23c-9c5a12918966 req-01b52ee2-d149-4daa-b65f-05075ce4c50b service nova] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Received event network-vif-deleted-7ea65cae-1b64-4669-aaab-da98da12b585 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26433666163363263', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433666163363263', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='7b9ca56a-7536-438b-8b2e-679baf270c0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2068243512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:28:05.124662',shelved_host='user',shelved_image_id='7b9ca56a-7536-438b-8b2e-679baf270c0d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_devices' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.objects.base [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<fb883135-2995-4186-8251-42cae4bd57c3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:30:10 user nova-compute[75373]:   <uuid>fb883135-2995-4186-8251-42cae4bd57c3</uuid>
Nov 29 07:30:10 user nova-compute[75373]:   <name>instance-00000014</name>
Nov 29 07:30:10 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:30:10 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:30:10 user nova-compute[75373]:   <metadata>
Nov 29 07:30:10 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:30:10 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-603230549</nova:name>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:30:08</nova:creationTime>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:30:10 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:30:10 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:owner>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:user uuid="6d67f374467c43e1b247a4fbc69e67d0">tempest-AttachVolumeShelveTestJSON-1812012148-project-member</nova:user>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:project uuid="c7fb2c66f2ee4df08d54238965f90bc6">tempest-AttachVolumeShelveTestJSON-1812012148</nova:project>
Nov 29 07:30:10 user nova-compute[75373]:       </nova:owner>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:root type="image" uuid="7b9ca56a-7536-438b-8b2e-679baf270c0d"/>
Nov 29 07:30:10 user nova-compute[75373]:       <nova:ports>
Nov 29 07:30:10 user nova-compute[75373]:         <nova:port uuid="bcb689a0-25f4-44c5-97a1-deb9e62d6ed8">
Nov 29 07:30:10 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 07:30:10 user nova-compute[75373]:         </nova:port>
Nov 29 07:30:10 user nova-compute[75373]:       </nova:ports>
Nov 29 07:30:10 user nova-compute[75373]:     </nova:instance>
Nov 29 07:30:10 user nova-compute[75373]:   </metadata>
Nov 29 07:30:10 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:30:10 user nova-compute[75373]:     <system>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="serial">fb883135-2995-4186-8251-42cae4bd57c3</entry>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="uuid">fb883135-2995-4186-8251-42cae4bd57c3</entry>
Nov 29 07:30:10 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:30:10 user nova-compute[75373]:     </system>
Nov 29 07:30:10 user nova-compute[75373]:   </sysinfo>
Nov 29 07:30:10 user nova-compute[75373]:   <os>
Nov 29 07:30:10 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:30:10 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:30:10 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:30:10 user nova-compute[75373]:   </os>
Nov 29 07:30:10 user nova-compute[75373]:   <features>
Nov 29 07:30:10 user nova-compute[75373]:     <acpi/>
Nov 29 07:30:10 user nova-compute[75373]:     <apic/>
Nov 29 07:30:10 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:30:10 user nova-compute[75373]:   </features>
Nov 29 07:30:10 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:30:10 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:30:10 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:30:10 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:30:10 user nova-compute[75373]:   </clock>
Nov 29 07:30:10 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:30:10 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:30:10 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:30:10 user nova-compute[75373]:   </cpu>
Nov 29 07:30:10 user nova-compute[75373]:   <devices>
Nov 29 07:30:10 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:30:10 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:30:10 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk"/>
Nov 29 07:30:10 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:30:10 user nova-compute[75373]:     </disk>
Nov 29 07:30:10 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:30:10 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:30:10 user nova-compute[75373]:       <source dev="/dev/sde"/>
Nov 29 07:30:10 user nova-compute[75373]:       <target dev="vdc" bus="virtio"/>
Nov 29 07:30:10 user nova-compute[75373]:       <serial>4564804a-aaef-40f8-8b84-b995ab86e821</serial>
Nov 29 07:30:10 user nova-compute[75373]:     </disk>
Nov 29 07:30:10 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:30:10 user nova-compute[75373]:       <mac address="fa:16:3e:b4:ef:46"/>
Nov 29 07:30:10 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:30:10 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:30:10 user nova-compute[75373]:       <target dev="tapbcb689a0-25"/>
Nov 29 07:30:10 user nova-compute[75373]:     </interface>
Nov 29 07:30:10 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:30:10 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/console.log" append="off"/>
Nov 29 07:30:10 user nova-compute[75373]:     </serial>
Nov 29 07:30:10 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:30:10 user nova-compute[75373]:     <video>
Nov 29 07:30:10 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:30:10 user nova-compute[75373]:     </video>
Nov 29 07:30:10 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:30:10 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:30:10 user nova-compute[75373]:     </rng>
Nov 29 07:30:10 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:30:10 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:30:10 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:30:10 user nova-compute[75373]:     </memballoon>
Nov 29 07:30:10 user nova-compute[75373]:   </devices>
Nov 29 07:30:10 user nova-compute[75373]: </domain>
Nov 29 07:30:10 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='7b9ca56a-7536-438b-8b2e-679baf270c0d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2068243512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:28:05.124662',shelved_host='user',shelved_image_id='7b9ca56a-7536-438b-8b2e-679baf270c0d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG os_vif [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '825b10b4-a790-58f8-933c-78d901cf3e75', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcb689a0-25, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcb689a0-25, col_values=(('qos', UUID('95d1c8ce-9298-46be-aa55-640371c7d4e3')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcb689a0-25, col_values=(('external_ids', {'iface-id': 'bcb689a0-25f4-44c5-97a1-deb9e62d6ed8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ef:46', 'vm-uuid': 'fb883135-2995-4186-8251-42cae4bd57c3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: INFO os_vif [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25')
Nov 29 07:30:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:30:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No VIF found with MAC fa:16:3e:b4:ef:46, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:30:11 user nova-compute[75373]: INFO nova.compute.manager [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] [instance: 5f526a92-a0db-4cde-9d68-765ff3d11470] Took 2.38 seconds to detach 3 volumes for instance.
Nov 29 07:30:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:11 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Deleted allocations for instance 5f526a92-a0db-4cde-9d68-765ff3d11470
Nov 29 07:30:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-61a64639-7574-408e-99f4-1c88f4c93fd8 tempest-TaggedBootDevicesTest_v242-1458404939 tempest-TaggedBootDevicesTest_v242-1458404939-project-member] Lock "5f526a92-a0db-4cde-9d68-765ff3d11470" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.583s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:12 user nova-compute[75373]: WARNING nova.compute.manager [req-0c78b70e-8810-4332-82f2-4d8a54ed8cc3 req-6ce3ff28-6900-43f6-894b-a97a74d06738 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 07:30:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:30:14 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance spawned successfully.
Nov 29 07:30:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:14 user nova-compute[75373]: WARNING nova.compute.manager [req-83d9531d-27b8-4c9e-97fa-d400f6aa789c req-49f8dcea-3385-41eb-8668-db4d8b3d57d2 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 07:30:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:30:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ce61a91f-5a98-4ea0-857a-ca12c1d9c6a1 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.435s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:36 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:30:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:30:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:30:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:30:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:30:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:30:37 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:37 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:41 user nova-compute[75373]: INFO nova.compute.manager [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Detaching volume fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:30:41 user nova-compute[75373]: INFO nova.virt.block_device [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Attempting to driver detach volume fc12b86a-751b-42be-97cb-21acb4f2476e from mountpoint /dev/vdb
Nov 29 07:30:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Attempting to detach device vdb from instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:30:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:30:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:30:41 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:30:41 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:30:41 user nova-compute[75373]:   <serial>fc12b86a-751b-42be-97cb-21acb4f2476e</serial>
Nov 29 07:30:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:30:41 user nova-compute[75373]: </disk>
Nov 29 07:30:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:30:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 from the persistent domain config.
Nov 29 07:30:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:30:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:30:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:30:41 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:30:41 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:30:41 user nova-compute[75373]:   <serial>fc12b86a-751b-42be-97cb-21acb4f2476e</serial>
Nov 29 07:30:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:30:41 user nova-compute[75373]: </disk>
Nov 29 07:30:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:42 user nova-compute[75373]: INFO nova.compute.manager [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Terminating instance
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-unplugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] No waiting events found dispatching network-vif-unplugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-ec4104ff-8a9d-40d7-8eea-87792ff4d298 req-c639ae03-cd80-458a-948d-bf95718e34b5 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-unplugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:30:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Instance destroyed successfully.
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'resources' on Instance uuid 7e23b02c-d997-46bc-b785-51fb6ce167ee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1195464956',display_name='tempest-tempest.common.compute-instance-1195464956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1195464956',id=16,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRsyHbG85w5HbekWqoBkp9Q3xxhdnfF9fbtrQ2lHMPLX3XKgW+qiLfO8CukIk9RO9oEjdOjWIiDWegj2ermUs3oLFNXiCJogCzxUmEkjsZuW1o4Vk5MNAGNdNONe0aslg==',key_name='tempest-keypair-1354867634',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-q8n3hu8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=7e23b02c-d997-46bc-b785-51fb6ce167ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "address": "fa:16:3e:63:24:b4", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69034705-57", "ovs_interfaceid": "69034705-573c-4d5e-8ba1-db0cab8e23c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG os_vif [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69034705-57, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcae7762-8f7d-40fa-879d-e1121fd28187) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:42 user nova-compute[75373]: INFO os_vif [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:24:b4,bridge_name='br-int',has_traffic_filtering=True,id=69034705-573c-4d5e-8ba1-db0cab8e23c4,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69034705-57')
Nov 29 07:30:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Deleting instance files /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee_del
Nov 29 07:30:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Deletion of /opt/stack/data/nova/instances/7e23b02c-d997-46bc-b785-51fb6ce167ee_del complete
Nov 29 07:30:42 user nova-compute[75373]: INFO nova.compute.manager [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 29 07:30:42 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:30:42 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-1ec4d228-ebfd-473b-8176-065e8c8a9596 req-66a5166a-3abc-4b14-b297-e22898a48a08 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-deleted-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:43 user nova-compute[75373]: INFO nova.compute.manager [req-1ec4d228-ebfd-473b-8176-065e8c8a9596 req-66a5166a-3abc-4b14-b297-e22898a48a08 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Neutron deleted interface 69034705-573c-4d5e-8ba1-db0cab8e23c4; detaching it from the instance and deleting it from the info cache
Nov 29 07:30:43 user nova-compute[75373]: DEBUG nova.network.neutron [req-1ec4d228-ebfd-473b-8176-065e8c8a9596 req-66a5166a-3abc-4b14-b297-e22898a48a08 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:30:43 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Took 0.83 seconds to deallocate network for instance.
Nov 29 07:30:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-1ec4d228-ebfd-473b-8176-065e8c8a9596 req-66a5166a-3abc-4b14-b297-e22898a48a08 service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Detach interface failed, port_id=69034705-573c-4d5e-8ba1-db0cab8e23c4, reason: Instance 7e23b02c-d997-46bc-b785-51fb6ce167ee could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:30:44 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '7e23b02c-d997-46bc-b785-51fb6ce167ee' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '7e23b02c-d997-46bc-b785-51fb6ce167ee' (instance-00000010)
Nov 29 07:30:44 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:44 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Deleted allocations for instance 7e23b02c-d997-46bc-b785-51fb6ce167ee
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9cc65d9f-dc61-4fb9-b1c8-de58929dced8 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] Acquiring lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] Lock "7e23b02c-d997-46bc-b785-51fb6ce167ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] No waiting events found dispatching network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:30:44 user nova-compute[75373]: WARNING nova.compute.manager [req-219484ec-d581-4710-8cae-da14619512ca req-6a8caded-2086-4428-9543-4d2ba88c954e service nova] [instance: 7e23b02c-d997-46bc-b785-51fb6ce167ee] Received unexpected event network-vif-plugged-69034705-573c-4d5e-8ba1-db0cab8e23c4 for instance with vm_state deleted and task_state None.
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:30:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:30:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:30:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=25.109455108642578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance fb883135-2995-4186-8251-42cae4bd57c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:30:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:30:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:30:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:30:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:01 user nova-compute[75373]: INFO nova.compute.manager [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Detaching volume 0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:31:01 user nova-compute[75373]: INFO nova.virt.block_device [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Attempting to driver detach volume 0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 from mountpoint /dev/vdb
Nov 29 07:31:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Attempting to detach device vdb from instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:31:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:01 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:01 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:31:01 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:01 user nova-compute[75373]:   <serial>0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3</serial>
Nov 29 07:31:01 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:31:01 user nova-compute[75373]: </disk>
Nov 29 07:31:01 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdb from instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 from the persistent domain config.
Nov 29 07:31:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:31:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:01 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:01 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:31:01 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:01 user nova-compute[75373]:   <serial>0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3</serial>
Nov 29 07:31:01 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:31:01 user nova-compute[75373]: </disk>
Nov 29 07:31:01 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:31:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 is timed out.
Nov 29 07:31:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 from the live domain config.
Nov 29 07:31:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyprXtbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2d21a6-bdc6-46af-8060-4a3a98139505]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:31:02 user nova-compute[75373]: No targets found.
Nov 29 07:31:02 user nova-compute[75373]: iSNS:
Nov 29 07:31:02 user nova-compute[75373]: No targets found.
Nov 29 07:31:02 user nova-compute[75373]: STATIC:
Nov 29 07:31:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:31:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e
Nov 29 07:31:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821
Nov 29 07:31:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:31:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:02 user nova-compute[75373]: FIRMWARE:
Nov 29 07:31:02 user nova-compute[75373]: No targets found.
Nov 29 07:31:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:31:02 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:31:02 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977a007-ea7e-4897-8025-19d5d318c806]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[66435307-6074-4c32-8c3a-ec10b49cc2aa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae04489d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c78e3c-61b8-4e32-a5f2-c7d2b2dc3dbc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[49746fcc-2b01-45f0-a539-315bce7dcaf9]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ef377-fe66-477c-908b-62e2f0b1196a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc07786-0f2c-4bea-a381-15292754eb77]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec63a9-2fd6-43f5-9d47-28c861a0e994]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330e908-7565-4391-8675-abaeec7ea31b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260]
Nov 29 07:31:02 user nova-compute[75373]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e, portal: 172.16.0.220,3260] successful.
Nov 29 07:31:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc12b86a-751b-42be-97cb-21acb4f2476e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa1b58d-274d-4dcb-9f52-b68821bd5b41]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== disconnect_volume: return (310ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:31:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:31:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-02b96c18-0627-4fd4-babe-b52c5a4c4a21 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing instance network info cache due to event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:31:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:31:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:31:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'flavor' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:11 user nova-compute[75373]: INFO nova.compute.manager [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Attaching volume 04a52303-f96a-4ea1-9566-76f68978ff52 to /dev/vdb
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.utils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[77035acf-648b-49ff-bb6d-5d1476dd2754]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fef8e5a-83fa-4f57-8fe3-b01359bf2d3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db8485-6c79-4e4b-9b4f-f6e0f0d67688]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4efcc0-23eb-4d87-a59d-b46e1341216a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:11 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd8e1d0-6e9d-4171-8b48-84dc1ca33f9d]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG os_brick.utils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating existing volume attachment record: d3ac76ce-33f1-4bcf-b0e4-9287edcbc4ed {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updated VIF entry in instance network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6ece6775-9d08-42d7-bfa7-88f291fc7ac9 req-7a9efb75-47ac-49f9-9429-f387931ad26a service nova] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:31:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing instance network info cache due to event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:31:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] Acquiring lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:31:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] Acquired lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:31:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updated VIF entry in instance network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0153d545-4762-4250-b9e6-13aa2c57cfa3 req-c74c4398-c9df-4725-b38b-fb111023f3e6 service nova] Releasing lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:18 user nova-compute[75373]: INFO nova.compute.manager [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Attaching volume 45750d84-d167-4992-8878-38ddba4825db to /dev/vdb
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.utils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f155a398-ec51-4f91-b5b9-dc590a685649]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9f7a3-3a46-4756-8804-dc5ecdd636c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf27cea-adbf-4983-83d9-5fab378176c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125e55f-db65-4c8d-a30a-ccd5ef2ae1d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:18 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:31:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[81949203-fb57-47cf-8821-26c6a007c0ff]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG os_brick.utils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:18 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating existing volume attachment record: ab566616-cca7-45fa-92c6-3b9b2d2d06c6 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRHjsYBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:19 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:19 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:19 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf8a03-3caa-48e9-b3da-007c065b00e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:31:19 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5285705-d7aa-4727-b303-40d057d87262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52] added
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a7333-2042-4fd4-9955-1fd3239ab5ac]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec013f39-dcb2-4143-b964-345a5845fa2c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRHjsYBo {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRHjsYBo" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcde3e8-8f50-4840-a484-7b11f644ee68]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRHjsYBo'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[803498d8-832f-4587-952a-36f086c96f91]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ff227b-b4e9-4b11-93d1-85cdcf61fba1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592aa85-d2e0-4307-84ff-b296a00204a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260]
Nov 29 07:31:19 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260] successful.
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fbc04f-8a40-4193-ba61-1bce4448c8be]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f28afa9-4dd6-4823-8abc-d0a8841c7106]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b573b69-5ec3-456d-8927-9d96df3e0141]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:31:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRHjsYBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23564656139666636', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564656139666636', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'flavor' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:31:20 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:20 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:31:20 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:20 user nova-compute[75373]:   <serial>04a52303-f96a-4ea1-9566-76f68978ff52</serial>
Nov 29 07:31:20 user nova-compute[75373]: </disk>
Nov 29 07:31:20 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:28:cf:ad, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0a0b31c7-b476-4e21-8ea0-216de3896615 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.122s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:21 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 is timed out.
Nov 29 07:31:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdb from instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 from the live domain config.
Nov 29 07:31:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOpGTLQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:21 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[84730963-e391-4adf-a81c-c7d0094525f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:31:21 user nova-compute[75373]: No targets found.
Nov 29 07:31:21 user nova-compute[75373]: iSNS:
Nov 29 07:31:21 user nova-compute[75373]: No targets found.
Nov 29 07:31:21 user nova-compute[75373]: STATIC:
Nov 29 07:31:21 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3
Nov 29 07:31:21 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:21 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:21 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:31:21 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:21 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:21 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821
Nov 29 07:31:21 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:21 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:21 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:31:21 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:21 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:21 user nova-compute[75373]: FIRMWARE:
Nov 29 07:31:21 user nova-compute[75373]: No targets found.
Nov 29 07:31:21 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:31:21 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:31:21 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:31:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9be357-dfe2-4ac5-a787-3b940fd51ae5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b3af6-c369-49a4-9418-f977c579b2e6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0492c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f445f62-0ed3-4c67-90e6-69fa49795eb1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f5a66-49ef-4909-89d6-bbce3dff1b7c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dba4cc-7132-4fbf-a8cd-6274e9bbdc84]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c817a1-b090-4609-953f-0b7d7695b5b3]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[212c1d73-1c67-404f-8cf0-cb9d98b37ce9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad5aa6b-472a-4c6f-84c3-f9a219f992bb]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260]
Nov 29 07:31:22 user nova-compute[75373]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3, portal: 172.16.0.220,3260] successful.
Nov 29 07:31:22 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ac4320c-b67d-4eec-b4d3-6c7b8f4089b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28f25d-12ae-42f3-ae76-3e4eaecf65d8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== disconnect_volume: return (354ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:31:22 user nova-compute[75373]: INFO nova.compute.manager [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Rescuing
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:31:22 user nova-compute[75373]: DEBUG nova.network.neutron [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c2047105-bf54-4f67-93bc-0ce59d2fc502 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.957s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:23 user nova-compute[75373]: WARNING nova.compute.manager [req-36a2279e-89e2-4261-a069-1c7b5c2bc334 req-9c8942da-c43a-42fe-bff0-4d7f3c6de045 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state active and task_state rescuing.
Nov 29 07:31:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance destroyed successfully.
Nov 29 07:31:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Attempting rescue
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:31:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Creating image(s)
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'trusted_certs' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue" returned: 0 in 0.063s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'migration_context' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.base [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<24470f28-4e72-4636-bcca-b0f45051aaeb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start _get_guest_xml network_info=[{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:28:cf:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75373) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.base [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<24470f28-4e72-4636-bcca-b0f45051aaeb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'numa_topology' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.base [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<24470f28-4e72-4636-bcca-b0f45051aaeb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:31:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:31:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.base [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<24470f28-4e72-4636-bcca-b0f45051aaeb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-161525513',display_name='tempest-ServerRescueNegativeTestJSON-server-161525513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-161525513',id=25,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY5CnNp5r34Hzz+zYVMb1RWStDYZDnAoGx/DpjoUZVNkg/fAO2qH6a9KOin6R23XcjuI7yxpjf/iAPETktSjg+oc3/7hjmV8jKyiCRaWTE794dLUnl6+mfqHGM3+87KUw==',key_name='tempest-keypair-54276433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:29:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-bpmc1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:29:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333925d6528d4e68bd23098c2f3513e5',uuid=24470f28-4e72-4636-bcca-b0f45051aaeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:28:cf:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "vif_mac": "fa:16:3e:28:cf:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.instance [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'pci_devices' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.objects.base [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Object Instance<24470f28-4e72-4636-bcca-b0f45051aaeb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:31:24 user nova-compute[75373]:   <uuid>24470f28-4e72-4636-bcca-b0f45051aaeb</uuid>
Nov 29 07:31:24 user nova-compute[75373]:   <name>instance-00000019</name>
Nov 29 07:31:24 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:31:24 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:31:24 user nova-compute[75373]:   <metadata>
Nov 29 07:31:24 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:31:24 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-161525513</nova:name>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:31:24</nova:creationTime>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:31:24 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:31:24 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:owner>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:user uuid="333925d6528d4e68bd23098c2f3513e5">tempest-ServerRescueNegativeTestJSON-1603259648-project-member</nova:user>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:project uuid="4259f5c423c347c8b36a7594ccec40cc">tempest-ServerRescueNegativeTestJSON-1603259648</nova:project>
Nov 29 07:31:24 user nova-compute[75373]:       </nova:owner>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:31:24 user nova-compute[75373]:       <nova:ports>
Nov 29 07:31:24 user nova-compute[75373]:         <nova:port uuid="33a9f936-8b7c-4c7a-b444-5cf150dc687e">
Nov 29 07:31:24 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:31:24 user nova-compute[75373]:         </nova:port>
Nov 29 07:31:24 user nova-compute[75373]:       </nova:ports>
Nov 29 07:31:24 user nova-compute[75373]:     </nova:instance>
Nov 29 07:31:24 user nova-compute[75373]:   </metadata>
Nov 29 07:31:24 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:31:24 user nova-compute[75373]:     <system>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="serial">24470f28-4e72-4636-bcca-b0f45051aaeb</entry>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="uuid">24470f28-4e72-4636-bcca-b0f45051aaeb</entry>
Nov 29 07:31:24 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:31:24 user nova-compute[75373]:     </system>
Nov 29 07:31:24 user nova-compute[75373]:   </sysinfo>
Nov 29 07:31:24 user nova-compute[75373]:   <os>
Nov 29 07:31:24 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:31:24 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:31:24 user nova-compute[75373]:   </os>
Nov 29 07:31:24 user nova-compute[75373]:   <features>
Nov 29 07:31:24 user nova-compute[75373]:     <acpi/>
Nov 29 07:31:24 user nova-compute[75373]:     <apic/>
Nov 29 07:31:24 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:31:24 user nova-compute[75373]:   </features>
Nov 29 07:31:24 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:31:24 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:31:24 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:31:24 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:31:24 user nova-compute[75373]:   </clock>
Nov 29 07:31:24 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:31:24 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:31:24 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:31:24 user nova-compute[75373]:   </cpu>
Nov 29 07:31:24 user nova-compute[75373]:   <devices>
Nov 29 07:31:24 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:31:24 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:31:24 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue"/>
Nov 29 07:31:24 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:31:24 user nova-compute[75373]:     </disk>
Nov 29 07:31:24 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:31:24 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:31:24 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk"/>
Nov 29 07:31:24 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:31:24 user nova-compute[75373]:     </disk>
Nov 29 07:31:24 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:31:24 user nova-compute[75373]:       <mac address="fa:16:3e:28:cf:ad"/>
Nov 29 07:31:24 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:31:24 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:31:24 user nova-compute[75373]:       <target dev="tap33a9f936-8b"/>
Nov 29 07:31:24 user nova-compute[75373]:     </interface>
Nov 29 07:31:24 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:31:24 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/console.log" append="off"/>
Nov 29 07:31:24 user nova-compute[75373]:     </serial>
Nov 29 07:31:24 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:31:24 user nova-compute[75373]:     <video>
Nov 29 07:31:24 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:31:24 user nova-compute[75373]:     </video>
Nov 29 07:31:24 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:31:24 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:31:24 user nova-compute[75373]:     </rng>
Nov 29 07:31:24 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:31:24 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:31:24 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:31:24 user nova-compute[75373]:     </memballoon>
Nov 29 07:31:24 user nova-compute[75373]:   </devices>
Nov 29 07:31:24 user nova-compute[75373]: </domain>
Nov 29 07:31:24 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:24 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance destroyed successfully.
Nov 29 07:31:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] No VIF found with MAC fa:16:3e:28:cf:ad, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:31:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance destroyed successfully.
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0bdb9e2f-4e56-4387-86ae-8bce8dab834f tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.358s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:25 user nova-compute[75373]: WARNING nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state active and task_state rescuing.
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:25 user nova-compute[75373]: WARNING nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state None.
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:25 user nova-compute[75373]: WARNING nova.compute.manager [req-941cf77a-75af-4031-9111-73c9ad1a567a req-9332671d-32b8-4039-a71e-808232c74032 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state None.
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unrgoWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:26 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:26 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:26 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:31:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524cd5f-dc4e-4540-9345-2911e79b3675]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:31:26 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c4b01d-5203-4718-b299-676da10004a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db] added
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1406e21-36e3-4c2b-bf19-eaf73041886a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c8fdd-8088-41a4-88f0-8cf084fd43d6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unrgoWZf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v unrgoWZf" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e360a-c528-4639-8239-21f51c64a132]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'unrgoWZf'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d15137-a64e-4f32-8e13-4e638a937b8b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2239558a-bd4d-4325-aaf6-fb2cde62cf75]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dfbd4b-f3a7-4cf1-a0a1-ec68e0671dda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260]
Nov 29 07:31:27 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260] successful.
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[88745b9b-9537-4928-bd48-523aae961794]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac45905-7f67-4e47-89a9-af7cc516c7e3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:27 user nova-compute[75373]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)
Nov 29 07:31:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e0034-5e05-444a-a966-7caaac41fb8c]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unrgoWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:27 user nova-compute[75373]: WARNING nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state active and task_state rescuing.
Nov 29 07:31:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:27 user nova-compute[75373]: WARNING nova.compute.manager [req-476aba8a-d5f3-4603-b334-4e807baf54ac req-ae28b331-daf8-4a95-8a89-f04fea899923 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state active and task_state rescuing.
Nov 29 07:31:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26133346161323239', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133346161323239', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.objects.instance [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:31:28 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:28 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:31:28 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:28 user nova-compute[75373]:   <serial>45750d84-d167-4992-8878-38ddba4825db</serial>
Nov 29 07:31:28 user nova-compute[75373]: </disk>
Nov 29 07:31:28 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-78fa5837-e78d-4e7e-b174-c86bacccfc54 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No VIF found with MAC fa:16:3e:c6:97:c3, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:31:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-86f0bbf1-0ac5-45da-87d1-f9dde58514f0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.241s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:31 user nova-compute[75373]: INFO nova.compute.manager [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Detaching volume 45750d84-d167-4992-8878-38ddba4825db
Nov 29 07:31:31 user nova-compute[75373]: INFO nova.virt.block_device [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Attempting to driver detach volume 45750d84-d167-4992-8878-38ddba4825db from mountpoint /dev/vdb
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Attempting to detach device vdb from instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:31 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:31 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:31:31 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:31 user nova-compute[75373]:   <serial>45750d84-d167-4992-8878-38ddba4825db</serial>
Nov 29 07:31:31 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:31:31 user nova-compute[75373]: </disk>
Nov 29 07:31:31 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:31 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully detached device vdb from instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 from the persistent domain config.
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:31 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:31 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:31:31 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:31:31 user nova-compute[75373]:   <serial>45750d84-d167-4992-8878-38ddba4825db</serial>
Nov 29 07:31:31 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:31:31 user nova-compute[75373]: </disk>
Nov 29 07:31:31 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:31:31 user nova-compute[75373]: INFO nova.compute.manager [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Terminating instance
Nov 29 07:31:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-unplugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] No waiting events found dispatching network-vif-unplugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-4964b400-2034-43f2-9b68-c7406ad4b68a req-ab275cff-18cb-42e3-802d-da06041f275f service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-unplugged-43faadde-ad57-4b96-913b-6f6c2aab789b for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Instance destroyed successfully.
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.objects.instance [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'resources' on Instance uuid 4f72ae79-e38e-4973-ae0c-60d4fcf78db4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1601426277',display_name='tempest-AttachVolumeNegativeTest-server-1601426277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1601426277',id=19,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMGni62DAkP9wiOpXTWWw/BgREVPYe2+bZgkU9lBvQb0ETqN0XdtQwtk91bSvwJYoKPiIvJxejYr13kavJVpZ7WO1wsYJj/LJHYetG+TK6MMI9/r/Im1fw44kGjzFHY4g==',key_name='tempest-keypair-939757089',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-vb5f0uoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=4f72ae79-e38e-4973-ae0c-60d4fcf78db4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "43faadde-ad57-4b96-913b-6f6c2aab789b", "address": "fa:16:3e:00:2b:11", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43faadde-ad", "ovs_interfaceid": "43faadde-ad57-4b96-913b-6f6c2aab789b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG os_vif [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43faadde-ad, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fe6f246-b70f-455c-8741-00eff0549c16) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:32 user nova-compute[75373]: INFO os_vif [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:11,bridge_name='br-int',has_traffic_filtering=True,id=43faadde-ad57-4b96-913b-6f6c2aab789b,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43faadde-ad')
Nov 29 07:31:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Deleting instance files /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4_del
Nov 29 07:31:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Deletion of /opt/stack/data/nova/instances/4f72ae79-e38e-4973-ae0c-60d4fcf78db4_del complete
Nov 29 07:31:32 user nova-compute[75373]: INFO nova.compute.manager [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 07:31:32 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:31:33 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:33 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Took 1.05 seconds to deallocate network for instance.
Nov 29 07:31:33 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:31:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:31:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:34 user nova-compute[75373]: INFO nova.compute.manager [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Unrescuing
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] Acquiring lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] No waiting events found dispatching network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:34 user nova-compute[75373]: WARNING nova.compute.manager [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received unexpected event network-vif-plugged-43faadde-ad57-4b96-913b-6f6c2aab789b for instance with vm_state deleted and task_state None.
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-7427f8c2-1dfb-4cc6-a6fd-186b1d3e1149 req-bd1d2d4d-e249-488a-a9be-bee585a03961 service nova] [instance: 4f72ae79-e38e-4973-ae0c-60d4fcf78db4] Received event network-vif-deleted-43faadde-ad57-4b96-913b-6f6c2aab789b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:34 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Deleted allocations for instance 4f72ae79-e38e-4973-ae0c-60d4fcf78db4
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55914de5-c721-43f1-b937-b259606d7b35 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "4f72ae79-e38e-4973-ae0c-60d4fcf78db4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG nova.objects.instance [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'flavor' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:35 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance destroyed successfully.
Nov 29 07:31:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:36 user nova-compute[75373]: WARNING nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:31:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:36 user nova-compute[75373]: WARNING nova.compute.manager [req-03d593d4-6bb4-4940-8b65-9d8f656e6ee1 req-b466bd84-a3ab-4c57-b7e4-45a15339a1e6 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:31:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:38 user nova-compute[75373]: WARNING nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:31:38 user nova-compute[75373]: WARNING nova.compute.manager [req-f4e4dcf1-b8dc-4224-a68c-e9dda076338c req-d05f2e7c-4760-4a15-803c-104696954771 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:31:38 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG nova.compute.manager [None req-aeaee200-a7b3-42d0-859f-10f3a2c1e0fc tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [{"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-6aff3409-81c6-4c41-9a03-8f4abfb318c9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:41 user nova-compute[75373]: INFO nova.compute.manager [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Detaching volume 4564804a-aaef-40f8-8b84-b995ab86e821
Nov 29 07:31:41 user nova-compute[75373]: INFO nova.virt.block_device [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Attempting to driver detach volume 4564804a-aaef-40f8-8b84-b995ab86e821 from mountpoint /dev/vdc
Nov 29 07:31:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Attempting to detach device vdc from instance fb883135-2995-4186-8251-42cae4bd57c3 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:31:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:41 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:31:41 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:31:41 user nova-compute[75373]:   <serial>4564804a-aaef-40f8-8b84-b995ab86e821</serial>
Nov 29 07:31:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:31:41 user nova-compute[75373]: </disk>
Nov 29 07:31:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully detached device vdc from instance fb883135-2995-4186-8251-42cae4bd57c3 from the persistent domain config.
Nov 29 07:31:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fb883135-2995-4186-8251-42cae4bd57c3 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:31:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:31:41 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:31:41 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:31:41 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:31:41 user nova-compute[75373]:   <serial>4564804a-aaef-40f8-8b84-b995ab86e821</serial>
Nov 29 07:31:41 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:31:41 user nova-compute[75373]: </disk>
Nov 29 07:31:41 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:31:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:31:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:31:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:31:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:31:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.143356323242188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance fb883135-2995-4186-8251-42cae4bd57c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:31:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.731s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:31:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 is timed out.
Nov 29 07:31:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully detached device vdb from instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 from the live domain config.
Nov 29 07:31:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'unrgoWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:51 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc5bd0-0b46-4757-b16e-5504cd51992c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:31:51 user nova-compute[75373]: No targets found.
Nov 29 07:31:51 user nova-compute[75373]: iSNS:
Nov 29 07:31:51 user nova-compute[75373]: No targets found.
Nov 29 07:31:51 user nova-compute[75373]: STATIC:
Nov 29 07:31:51 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db
Nov 29 07:31:51 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:51 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:51 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:31:51 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:51 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:51 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821
Nov 29 07:31:51 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:51 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:51 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:31:51 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:31:51 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:31:51 user nova-compute[75373]: FIRMWARE:
Nov 29 07:31:51 user nova-compute[75373]: No targets found.
Nov 29 07:31:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:31:51 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:31:51 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8a31f6-0ba1-4952-9b06-c09b362b8192]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52c6be3-a371-411b-af68-aea19d4f1944]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)
Nov 29 07:31:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:31:51 user nova-compute[75373]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db (non-flash)
Nov 29 07:31:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08932dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d68ab5-ddf8-4963-acce-28dc09bf003f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2fc94-5b65-4ab6-b216-182f6b20cebe]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[851a06a8-989b-47ac-99ec-747411e7c366]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c9a11d-eefc-49c9-869f-1e6c1ccdcefc]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a057bddb-7090-43fd-bafd-ff947c146028]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a6c22-c8cc-4332-9321-93d9d4869686]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260]
Nov 29 07:31:52 user nova-compute[75373]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db, portal: 172.16.0.220,3260] successful.
Nov 29 07:31:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45750d84-d167-4992-8878-38ddba4825db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b4d268-3137-4b24-b659-c7bd2d4b1bec]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== disconnect_volume: return (296ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG nova.objects.instance [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-839da97c-ba91-4472-985d-abed745f1a40 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.716s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'flavor' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:31:58 user nova-compute[75373]: INFO nova.compute.manager [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Attaching volume 3de1f005-e019-463e-ad53-82c9095e62ef to /dev/vdb
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.utils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1c3b0-458f-46c6-9834-a4836422100c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a18079-32c7-4365-ad96-8733f7a009ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090fbc8-b4e0-4e5d-9e53-a9115c3bfd13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[155cdaeb-20e0-4e25-9e52-3d5a79407888]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:31:58 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:31:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b826973-72c7-4ebf-be23-e7f9593a135d]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG os_brick.utils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:31:58 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating existing volume attachment record: 196eb194-09f3-4aff-8465-5fc408976cec {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:32:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fb883135-2995-4186-8251-42cae4bd57c3 is timed out.
Nov 29 07:32:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully detached device vdc from instance fb883135-2995-4186-8251-42cae4bd57c3 from the live domain config.
Nov 29 07:32:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EBivkRZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce271b-b365-49dc-acb5-edaaf5536a93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:32:02 user nova-compute[75373]: No targets found.
Nov 29 07:32:02 user nova-compute[75373]: iSNS:
Nov 29 07:32:02 user nova-compute[75373]: No targets found.
Nov 29 07:32:02 user nova-compute[75373]: STATIC:
Nov 29 07:32:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:32:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821
Nov 29 07:32:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:32:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:02 user nova-compute[75373]: FIRMWARE:
Nov 29 07:32:02 user nova-compute[75373]: No targets found.
Nov 29 07:32:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:32:02 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:32:02 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8c200-6418-4427-96ca-5cb32b727fbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d21527-0ecd-4aa4-a9c3-f0113aafd804]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0041ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643655d-c1aa-44a8-9f57-83091438a173]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a1f7be-e012-46a6-b9fa-19188c3361be]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e4b88-5ab3-45df-8055-21b3182db4ee]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da9c8c-19e6-48ba-be56-a68b1c9516bd]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c759384-a00e-4710-a8d6-0029d3170640]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[241a3702-d66c-46cd-8db3-2f3e5ac54097]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260]
Nov 29 07:32:02 user nova-compute[75373]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821, portal: 172.16.0.220,3260] successful.
Nov 29 07:32:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4564804a-aaef-40f8-8b84-b995ab86e821 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a20b43-f2d8-4d1c-ad24-cb8933674cdc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] <== disconnect_volume: return (325ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:32:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'flavor' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bc0841b8-9921-4ea8-a103-b52e4f424e40 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:06 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:06 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:06 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b850301d-5209-459a-a8b5-0ff6a53d5159]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:32:06 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e431aff-136f-493f-91dd-988ec84d1e80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9aa6f-4594-4be1-af91-90b883a00679]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a76ba-96d0-4d1c-a36f-a6c8a8b53b26]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b43ef33-f6c3-4017-a51c-993543268890]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWAwTYrh'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1075a1-4bd9-4695-b8f5-d3dc655558df]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a0556-c80f-4901-bd75-7bd268e14b78]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff8623-8b78-4c77-a48e-1ba06fa544a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:32:06 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f46bf3-6239-461b-8160-f30d7522410d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940305b-128e-40d6-bafa-6b4ccc8f3a90]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:06 user nova-compute[75373]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bd3caf-8477-4691-b78e-c4d888e64fec]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:32:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'flavor' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:32:07 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:32:07 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:32:07 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:32:07 user nova-compute[75373]:   <serial>3de1f005-e019-463e-ad53-82c9095e62ef</serial>
Nov 29 07:32:07 user nova-compute[75373]: </disk>
Nov 29 07:32:07 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:32:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No VIF found with MAC fa:16:3e:8f:df:fb, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a04aacc0-4069-438b-87fd-50e18a1b49a6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.142s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Stashing vm_state: active {{(pid=75373) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:32:11 user nova-compute[75373]: INFO nova.compute.claims [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Claim successful on node user
Nov 29 07:32:11 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating resource usage from migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28
Nov 29 07:32:11 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.416s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:11 user nova-compute[75373]: INFO nova.compute.manager [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Migrating
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:11 user nova-compute[75373]: INFO nova.compute.rpcapi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 07:32:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG nova.network.neutron [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG nova.network.neutron [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Starting migrate_disk_and_power_off {{(pid=75373) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:12 user nova-compute[75373]: WARNING nova.compute.manager [req-9e900d1e-dffe-429b-9f6c-0470ddb88dc9 req-0bcbdebd-8aa8-4e05-9dfa-d47a498b1c1b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state active and task_state resize_migrating.
Nov 29 07:32:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance destroyed successfully.
Nov 29 07:32:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68cb76a9-e3, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6db43777-c134-4b7d-88d5-a26be56bf648) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:13 user nova-compute[75373]: INFO os_vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:32:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:13 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[84791ebb-abd1-444d-ad5b-2b6f020e06d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:32:13 user nova-compute[75373]: No targets found.
Nov 29 07:32:13 user nova-compute[75373]: iSNS:
Nov 29 07:32:13 user nova-compute[75373]: No targets found.
Nov 29 07:32:13 user nova-compute[75373]: STATIC:
Nov 29 07:32:13 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:32:13 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:13 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:13 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:32:13 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:13 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:13 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:32:13 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:32:13 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:32:13 user nova-compute[75373]: FIRMWARE:
Nov 29 07:32:13 user nova-compute[75373]: No targets found.
Nov 29 07:32:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:32:13 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:32:13 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.062s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1dfc04-1bb6-4980-8490-69bd44f5e68b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[77563c43-2065-4324-985f-7d5465dffbb6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:13 user nova-compute[75373]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:13 user nova-compute[75373]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0068fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ec1e7-60c2-49b6-a580-49637d332a5f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b5686a-915e-4a72-b444-b8cd67c0ac29]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6938d2c5-0f98-4e09-927c-bfc2d8ec4239]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b3b4e-71e0-4e1a-9de4-f0c63903ab39]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1906cc-0715-4500-abd8-d63bea95ce73]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa66a22-0351-4195-967a-1eadb1f86678]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:32:13 user nova-compute[75373]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:32:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91e51e-035f-46da-af51-4d6d8302569e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== disconnect_volume: return (352ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_resize/disk /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "cp -r /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_resize/disk /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk" returned: 0 in 0.373s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_resize/disk.info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk.info {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "cp -r /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_resize/disk.info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk.info" returned: 0 in 0.051s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:14 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:32:14 user nova-compute[75373]: INFO nova.compute.claims [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Claim successful on node user
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:15 user nova-compute[75373]: WARNING nova.compute.manager [req-790534b8-b8c9-4409-a596-2cefeb2c6175 req-13822fff-8f72-4f1b-a44f-656b4bf138ae service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state active and task_state resize_migrating.
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:32:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.policy [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39b41ea8ed064f2e80ed67fde84b6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65289e019d8a46efb9f46dd41358ed16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Port 68cb76a9-e30c-4470-97d6-9e028490a7fe binding to destination host user is already ACTIVE {{(pid=75373) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:32:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Creating image(s)
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "/opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "/opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "/opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.226s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk 1073741824" returned: 0 in 0.054s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Cannot resize image /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Ensure instance console log exists: /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Successfully created port: 0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac53d432-96c2-4a5e-ac53-657d5c536c87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3119dc-1f33-4b96-aeec-8117cee6cd59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95acacd-1a7c-4d92-9f10-aee933a82b28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d164e4-6a52-4c57-8700-2568b10a70cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:32:16 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:32:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc115406-b094-4153-8c26-1056e2a558e7]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:32:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Successfully updated port: 0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquired lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-changed-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Refreshing instance network info cache due to event network-changed-0b11f649-abec-4189-a9f0-42e0771eead0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] Acquiring lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating instance_info_cache with network_info: [{"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Releasing lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Instance network_info: |[{"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] Acquired lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Refreshing network info cache for port 0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Start _get_guest_xml network_info=[{"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:32:17 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:17 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755320239',display_name='tempest-VolumesSnapshotTestJSON-instance-1755320239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755320239',id=27,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQhs+Gc4KAdseLkn6YVG5Hcl2RZn7rDbKSbXtRczuVA3wRHlrqS6vEwOGSB03HaMJ9Mnf4mSBEad3DaSHqlYtqXjFa4njrnAFuWL2CDJELYMZeMJ49s1sf6NOOFhwkNVQ==',key_name='tempest-keypair-2114015273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-d3yzduwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=69e4c87f-c3fa-44df-8abc-acdc84a179c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'pci_devices' on Instance uuid 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:32:17 user nova-compute[75373]:   <uuid>69e4c87f-c3fa-44df-8abc-acdc84a179c0</uuid>
Nov 29 07:32:17 user nova-compute[75373]:   <name>instance-0000001b</name>
Nov 29 07:32:17 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:32:17 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:32:17 user nova-compute[75373]:   <metadata>
Nov 29 07:32:17 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:32:17 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1755320239</nova:name>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:32:17</nova:creationTime>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:32:17 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:32:17 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:owner>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:user uuid="39b41ea8ed064f2e80ed67fde84b6456">tempest-VolumesSnapshotTestJSON-155394523-project-member</nova:user>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:project uuid="65289e019d8a46efb9f46dd41358ed16">tempest-VolumesSnapshotTestJSON-155394523</nova:project>
Nov 29 07:32:17 user nova-compute[75373]:       </nova:owner>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:32:17 user nova-compute[75373]:       <nova:ports>
Nov 29 07:32:17 user nova-compute[75373]:         <nova:port uuid="0b11f649-abec-4189-a9f0-42e0771eead0">
Nov 29 07:32:17 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:32:17 user nova-compute[75373]:         </nova:port>
Nov 29 07:32:17 user nova-compute[75373]:       </nova:ports>
Nov 29 07:32:17 user nova-compute[75373]:     </nova:instance>
Nov 29 07:32:17 user nova-compute[75373]:   </metadata>
Nov 29 07:32:17 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:32:17 user nova-compute[75373]:     <system>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="serial">69e4c87f-c3fa-44df-8abc-acdc84a179c0</entry>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="uuid">69e4c87f-c3fa-44df-8abc-acdc84a179c0</entry>
Nov 29 07:32:17 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:32:17 user nova-compute[75373]:     </system>
Nov 29 07:32:17 user nova-compute[75373]:   </sysinfo>
Nov 29 07:32:17 user nova-compute[75373]:   <os>
Nov 29 07:32:17 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:32:17 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:32:17 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:32:17 user nova-compute[75373]:   </os>
Nov 29 07:32:17 user nova-compute[75373]:   <features>
Nov 29 07:32:17 user nova-compute[75373]:     <acpi/>
Nov 29 07:32:17 user nova-compute[75373]:     <apic/>
Nov 29 07:32:17 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:32:17 user nova-compute[75373]:   </features>
Nov 29 07:32:17 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:32:17 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:32:17 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:32:17 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:32:17 user nova-compute[75373]:   </clock>
Nov 29 07:32:17 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:32:17 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:32:17 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:32:17 user nova-compute[75373]:   </cpu>
Nov 29 07:32:17 user nova-compute[75373]:   <devices>
Nov 29 07:32:17 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:32:17 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:32:17 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk"/>
Nov 29 07:32:17 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:32:17 user nova-compute[75373]:     </disk>
Nov 29 07:32:17 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:32:17 user nova-compute[75373]:       <mac address="fa:16:3e:82:c8:d1"/>
Nov 29 07:32:17 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:17 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:32:17 user nova-compute[75373]:       <target dev="tap0b11f649-ab"/>
Nov 29 07:32:17 user nova-compute[75373]:     </interface>
Nov 29 07:32:17 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:32:17 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/console.log" append="off"/>
Nov 29 07:32:17 user nova-compute[75373]:     </serial>
Nov 29 07:32:17 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:32:17 user nova-compute[75373]:     <video>
Nov 29 07:32:17 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:17 user nova-compute[75373]:     </video>
Nov 29 07:32:17 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:32:17 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:32:17 user nova-compute[75373]:     </rng>
Nov 29 07:32:17 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:32:17 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:32:17 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:32:17 user nova-compute[75373]:     </memballoon>
Nov 29 07:32:17 user nova-compute[75373]:   </devices>
Nov 29 07:32:17 user nova-compute[75373]: </domain>
Nov 29 07:32:17 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755320239',display_name='tempest-VolumesSnapshotTestJSON-instance-1755320239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755320239',id=27,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQhs+Gc4KAdseLkn6YVG5Hcl2RZn7rDbKSbXtRczuVA3wRHlrqS6vEwOGSB03HaMJ9Mnf4mSBEad3DaSHqlYtqXjFa4njrnAFuWL2CDJELYMZeMJ49s1sf6NOOFhwkNVQ==',key_name='tempest-keypair-2114015273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-d3yzduwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=69e4c87f-c3fa-44df-8abc-acdc84a179c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG os_vif [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be1106a8-01c1-5fb8-9a6d-8ac71b72b2bc', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b11f649-ab, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b11f649-ab, col_values=(('qos', UUID('41e4a5d0-6b3c-4baa-b481-9bc307ad9660')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b11f649-ab, col_values=(('external_ids', {'iface-id': '0b11f649-abec-4189-a9f0-42e0771eead0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c8:d1', 'vm-uuid': '69e4c87f-c3fa-44df-8abc-acdc84a179c0'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:17 user nova-compute[75373]: INFO os_vif [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab')
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No VIF found with MAC fa:16:3e:82:c8:d1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updated VIF entry in instance network info cache for port 0b11f649-abec-4189-a9f0-42e0771eead0. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating instance_info_cache with network_info: [{"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-edfcaaa3-ab52-4b12-a89b-bff25f16752d req-4dfd7d90-3bd4-4587-88bd-bb79c697df33 service nova] Releasing lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] No waiting events found dispatching network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:19 user nova-compute[75373]: WARNING nova.compute.manager [req-76c3610b-1ad3-4edd-8835-81891709d5ee req-9392cae2-ee6a-49d2-b450-6a9232b23c39 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received unexpected event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 for instance with vm_state building and task_state spawning.
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] No waiting events found dispatching network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:21 user nova-compute[75373]: WARNING nova.compute.manager [req-9c128986-0107-4f43-87a0-1d5ed2cf6ba1 req-6344ecc4-329c-4d8d-9cf8-9e179eab62ce service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received unexpected event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 for instance with vm_state building and task_state spawning.
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:32:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Instance spawned successfully.
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:21 user nova-compute[75373]: INFO nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 29 07:32:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:32:21 user nova-compute[75373]: INFO nova.compute.manager [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Took 6.94 seconds to build instance.
Nov 29 07:32:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8c80cb0-320c-41ae-965a-ac86360a6fac tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.046s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Starting finish_migration {{(pid=75373) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:32:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Creating image(s)
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk. size=21474836480 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk 21474836480 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk 21474836480" returned: 0 in 0.071s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Ensure instance console log exists: /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start _get_guest_xml network_info=[{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f44b466e-2b87-414a-a4f7-d951d0a015c3', 'attached_at': '2023-11-29T07:32:25.000000', 'detached_at': '', 'volume_id': '3de1f005-e019-463e-ad53-82c9095e62ef', 'serial': '3de1f005-e019-463e-ad53-82c9095e62ef'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'f6f1e06b-7a8b-4619-8ce2-549fbba1b069', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:32:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:25 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:32:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec82de-2474-4c68-bf9a-f516d2773b17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:32:25 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6946ce-4e4a-4f7b-b833-177de81696a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added
Nov 29 07:32:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0794c644-7583-46f6-8bd9-b0852fccec67]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf6d959-f6f1-4f5c-9cd8-4cf0166f0f81]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055a82b-fd24-40ab-b115-d37a28df02b0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWAwTYrh'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.067s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa3b0f3-392b-4323-aa0b-8e60c03d5126]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d2508-a8d9-4b25-b28d-074a793eb94e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:25 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:25 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd026e-8db1-4085-b042-bb9e0bbaeead]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:32:25 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:32:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[90104a54-d877-4c1a-a3a1-9284d9874765]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1fd796-0cfa-4169-b358-f5e2f687063a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:26 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:26 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:26 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:26 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:26 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:26 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[68114374-6f98-44b4-8603-f9c3a0d5b10d]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:26 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:32:26 user nova-compute[75373]: INFO nova.compute.claims [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Claim successful on node user
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:32:27 user nova-compute[75373]:   <uuid>f44b466e-2b87-414a-a4f7-d951d0a015c3</uuid>
Nov 29 07:32:27 user nova-compute[75373]:   <name>instance-00000018</name>
Nov 29 07:32:27 user nova-compute[75373]:   <memory>2097152</memory>
Nov 29 07:32:27 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:32:27 user nova-compute[75373]:   <metadata>
Nov 29 07:32:27 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:32:27 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127939767</nova:name>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:32:25</nova:creationTime>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:flavor name="m1.small">
Nov 29 07:32:27 user nova-compute[75373]:         <nova:memory>2048</nova:memory>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:disk>20</nova:disk>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:32:27 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:owner>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:user uuid="b4c03943036e49e3b5021c5784e42ed0">tempest-ServerActionsTestOtherB-1291056582-project-member</nova:user>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:project uuid="4e613704433449d9a6db31215d1b6867">tempest-ServerActionsTestOtherB-1291056582</nova:project>
Nov 29 07:32:27 user nova-compute[75373]:       </nova:owner>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:32:27 user nova-compute[75373]:       <nova:ports>
Nov 29 07:32:27 user nova-compute[75373]:         <nova:port uuid="68cb76a9-e30c-4470-97d6-9e028490a7fe">
Nov 29 07:32:27 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:32:27 user nova-compute[75373]:         </nova:port>
Nov 29 07:32:27 user nova-compute[75373]:       </nova:ports>
Nov 29 07:32:27 user nova-compute[75373]:     </nova:instance>
Nov 29 07:32:27 user nova-compute[75373]:   </metadata>
Nov 29 07:32:27 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:32:27 user nova-compute[75373]:     <system>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="serial">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="uuid">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:32:27 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:32:27 user nova-compute[75373]:     </system>
Nov 29 07:32:27 user nova-compute[75373]:   </sysinfo>
Nov 29 07:32:27 user nova-compute[75373]:   <os>
Nov 29 07:32:27 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:32:27 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:32:27 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:32:27 user nova-compute[75373]:   </os>
Nov 29 07:32:27 user nova-compute[75373]:   <features>
Nov 29 07:32:27 user nova-compute[75373]:     <acpi/>
Nov 29 07:32:27 user nova-compute[75373]:     <apic/>
Nov 29 07:32:27 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:32:27 user nova-compute[75373]:   </features>
Nov 29 07:32:27 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:32:27 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:32:27 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:32:27 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:32:27 user nova-compute[75373]:   </clock>
Nov 29 07:32:27 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:32:27 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:32:27 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:32:27 user nova-compute[75373]:   </cpu>
Nov 29 07:32:27 user nova-compute[75373]:   <devices>
Nov 29 07:32:27 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:32:27 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:32:27 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk"/>
Nov 29 07:32:27 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:32:27 user nova-compute[75373]:     </disk>
Nov 29 07:32:27 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:32:27 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:32:27 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:32:27 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:32:27 user nova-compute[75373]:       <serial>3de1f005-e019-463e-ad53-82c9095e62ef</serial>
Nov 29 07:32:27 user nova-compute[75373]:     </disk>
Nov 29 07:32:27 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:32:27 user nova-compute[75373]:       <mac address="fa:16:3e:8f:df:fb"/>
Nov 29 07:32:27 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:27 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:32:27 user nova-compute[75373]:       <target dev="tap68cb76a9-e3"/>
Nov 29 07:32:27 user nova-compute[75373]:     </interface>
Nov 29 07:32:27 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:32:27 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/console.log" append="off"/>
Nov 29 07:32:27 user nova-compute[75373]:     </serial>
Nov 29 07:32:27 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:32:27 user nova-compute[75373]:     <video>
Nov 29 07:32:27 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:27 user nova-compute[75373]:     </video>
Nov 29 07:32:27 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:32:27 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:32:27 user nova-compute[75373]:     </rng>
Nov 29 07:32:27 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:32:27 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:32:27 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:32:27 user nova-compute[75373]:     </memballoon>
Nov 29 07:32:27 user nova-compute[75373]:   </devices>
Nov 29 07:32:27 user nova-compute[75373]: </domain>
Nov 29 07:32:27 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1171201028-network", "vif_mac": "fa:16:3e:8f:df:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG os_vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:32:27 user nova-compute[75373]: INFO nova.compute.manager [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] instance snapshotting
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c5c4692-9b26-5ae2-91d0-02e064d8bbae', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68cb76a9-e3, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68cb76a9-e3, col_values=(('qos', UUID('ee996e2a-a3a4-44fb-bd8e-3e0659405b2c')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68cb76a9-e3, col_values=(('external_ids', {'iface-id': '68cb76a9-e30c-4470-97d6-9e028490a7fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:df:fb', 'vm-uuid': 'f44b466e-2b87-414a-a4f7-d951d0a015c3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:27 user nova-compute[75373]: INFO os_vif [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:32:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Beginning live snapshot process
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] No VIF found with MAC fa:16:3e:8f:df:fb, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:32:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.policy [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fa1e258308644589a58d3ba9b99d09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32b5fe43b84c2b9df54631c7a3edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:32:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Creating image(s)
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "/opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429.delta 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429.delta 1073741824" returned: 0 in 0.050s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk 1073741824" returned: 0 in 0.062s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Successfully created port: d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Cannot resize image /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Ensure instance console log exists: /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Successfully updated port: d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquired lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-changed-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Refreshing instance network info cache due to event network-changed-d863c757-140b-46a8-8366-b155c1a33265. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:32:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] Acquiring lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updating instance_info_cache with network_info: [{"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Releasing lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Instance network_info: |[{"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] Acquired lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Refreshing network info cache for port d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Start _get_guest_xml network_info=[{"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078329021',display_name='tempest-AttachVolumeNegativeTest-server-2078329021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078329021',id=28,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqtmiUEstR2Sz6TIZ0QeI9MH+YoAxBOBWXb9DpBUkc62pedvU+4eoFzWGItZV4IoQJPolIEl5nFaJZURYAhRBrbHQW8+TQOgpUtAgmRSArJCIxlsZsQuzR2vwzzEztHXw==',key_name='tempest-keypair-929703094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-nzldu4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=69653ee0-5044-45da-ac6a-407d4cc66740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.objects.instance [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'pci_devices' on Instance uuid 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:32:29 user nova-compute[75373]:   <uuid>69653ee0-5044-45da-ac6a-407d4cc66740</uuid>
Nov 29 07:32:29 user nova-compute[75373]:   <name>instance-0000001c</name>
Nov 29 07:32:29 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:32:29 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:32:29 user nova-compute[75373]:   <metadata>
Nov 29 07:32:29 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:32:29 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2078329021</nova:name>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:32:29</nova:creationTime>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:32:29 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:32:29 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:owner>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:user uuid="0fa1e258308644589a58d3ba9b99d09a">tempest-AttachVolumeNegativeTest-2030774109-project-member</nova:user>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:project uuid="fc32b5fe43b84c2b9df54631c7a3edb9">tempest-AttachVolumeNegativeTest-2030774109</nova:project>
Nov 29 07:32:29 user nova-compute[75373]:       </nova:owner>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:32:29 user nova-compute[75373]:       <nova:ports>
Nov 29 07:32:29 user nova-compute[75373]:         <nova:port uuid="d863c757-140b-46a8-8366-b155c1a33265">
Nov 29 07:32:29 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 07:32:29 user nova-compute[75373]:         </nova:port>
Nov 29 07:32:29 user nova-compute[75373]:       </nova:ports>
Nov 29 07:32:29 user nova-compute[75373]:     </nova:instance>
Nov 29 07:32:29 user nova-compute[75373]:   </metadata>
Nov 29 07:32:29 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:32:29 user nova-compute[75373]:     <system>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="serial">69653ee0-5044-45da-ac6a-407d4cc66740</entry>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="uuid">69653ee0-5044-45da-ac6a-407d4cc66740</entry>
Nov 29 07:32:29 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:32:29 user nova-compute[75373]:     </system>
Nov 29 07:32:29 user nova-compute[75373]:   </sysinfo>
Nov 29 07:32:29 user nova-compute[75373]:   <os>
Nov 29 07:32:29 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:32:29 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:32:29 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:32:29 user nova-compute[75373]:   </os>
Nov 29 07:32:29 user nova-compute[75373]:   <features>
Nov 29 07:32:29 user nova-compute[75373]:     <acpi/>
Nov 29 07:32:29 user nova-compute[75373]:     <apic/>
Nov 29 07:32:29 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:32:29 user nova-compute[75373]:   </features>
Nov 29 07:32:29 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:32:29 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:32:29 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:32:29 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:32:29 user nova-compute[75373]:   </clock>
Nov 29 07:32:29 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:32:29 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:32:29 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:32:29 user nova-compute[75373]:   </cpu>
Nov 29 07:32:29 user nova-compute[75373]:   <devices>
Nov 29 07:32:29 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:32:29 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:32:29 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk"/>
Nov 29 07:32:29 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:32:29 user nova-compute[75373]:     </disk>
Nov 29 07:32:29 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:32:29 user nova-compute[75373]:       <mac address="fa:16:3e:13:65:bf"/>
Nov 29 07:32:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:29 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:32:29 user nova-compute[75373]:       <target dev="tapd863c757-14"/>
Nov 29 07:32:29 user nova-compute[75373]:     </interface>
Nov 29 07:32:29 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:32:29 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/console.log" append="off"/>
Nov 29 07:32:29 user nova-compute[75373]:     </serial>
Nov 29 07:32:29 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:32:29 user nova-compute[75373]:     <video>
Nov 29 07:32:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:29 user nova-compute[75373]:     </video>
Nov 29 07:32:29 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:32:29 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:32:29 user nova-compute[75373]:     </rng>
Nov 29 07:32:29 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:32:29 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:32:29 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:32:29 user nova-compute[75373]:     </memballoon>
Nov 29 07:32:29 user nova-compute[75373]:   </devices>
Nov 29 07:32:29 user nova-compute[75373]: </domain>
Nov 29 07:32:29 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078329021',display_name='tempest-AttachVolumeNegativeTest-server-2078329021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078329021',id=28,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqtmiUEstR2Sz6TIZ0QeI9MH+YoAxBOBWXb9DpBUkc62pedvU+4eoFzWGItZV4IoQJPolIEl5nFaJZURYAhRBrbHQW8+TQOgpUtAgmRSArJCIxlsZsQuzR2vwzzEztHXw==',key_name='tempest-keypair-929703094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-nzldu4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=69653ee0-5044-45da-ac6a-407d4cc66740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG os_vif [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a9cbbe4-39d9-5219-971a-f1fc0b46de2c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd863c757-14, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd863c757-14, col_values=(('qos', UUID('5ae812df-8109-46f8-bf1b-4302f08ac2db')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd863c757-14, col_values=(('external_ids', {'iface-id': 'd863c757-140b-46a8-8366-b155c1a33265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:65:bf', 'vm-uuid': '69653ee0-5044-45da-ac6a-407d4cc66740'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:29 user nova-compute[75373]: INFO os_vif [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14')
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:13:65:bf, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:29 user nova-compute[75373]: WARNING nova.compute.manager [req-cbe128e0-93c1-4369-aedd-49c6a3f5774f req-b59162e6-37eb-495b-b09a-aff65d7d1282 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state active and task_state resize_finish.
Nov 29 07:32:29 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:32:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429.delta /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updated VIF entry in instance network info cache for port d863c757-140b-46a8-8366-b155c1a33265. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updating instance_info_cache with network_info: [{"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e85fb783-b138-420f-9c56-134fc0a0e229 req-8f22c61e-decb-45f7-be78-5741c1da62e4 service nova] Releasing lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429.delta /opt/stack/data/nova/instances/snapshots/tmpqvtalwsv/e7bc429a2cbf41d9be3843cbcca65429" returned: 0 in 0.769s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:30 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Snapshot extracted, beginning image upload
Nov 29 07:32:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:31 user nova-compute[75373]: WARNING nova.compute.manager [req-7a6a3106-d964-46a2-a943-8dbf8ae8e59e req-7f5040d3-baef-40b7-8720-6dfa26771438 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state active and task_state resize_finish.
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] No waiting events found dispatching network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:32 user nova-compute[75373]: WARNING nova.compute.manager [req-8d2570cb-699f-4164-b308-c2c583e88370 req-d45a4d07-1ebd-4308-8893-975ef3f9b12f service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received unexpected event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 for instance with vm_state building and task_state spawning.
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:32 user nova-compute[75373]: INFO nova.compute.manager [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Terminating instance
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-1019fb3f-32e4-48bd-b6ca-c37d3d3102e6 req-e5a124b6-f1a8-4c51-bdc9-fd104af7589d service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-unplugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Instance destroyed successfully.
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.objects.instance [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'resources' on Instance uuid fb883135-2995-4186-8251-42cae4bd57c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-603230549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-603230549',id=20,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMPlbPhQhQnyH54iqayg4Q326Sp2euaHqI4nlFgsvZy8b4uTpmXgIPWOPBRUr/cdMLe3U423H8KtW3BQmF3QRdIzs1zXLk4N/HO2r8lEmzwgEuFDgSxhBYs1vSK/6C0JQ==',key_name='tempest-keypair-2068243512',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:30:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-rf048ciu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=fb883135-2995-4186-8251-42cae4bd57c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "address": "fa:16:3e:b4:ef:46", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcb689a0-25", "ovs_interfaceid": "bcb689a0-25f4-44c5-97a1-deb9e62d6ed8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG os_vif [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcb689a0-25, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95d1c8ce-9298-46be-aa55-640371c7d4e3) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:33 user nova-compute[75373]: INFO os_vif [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ef:46,bridge_name='br-int',has_traffic_filtering=True,id=bcb689a0-25f4-44c5-97a1-deb9e62d6ed8,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcb689a0-25')
Nov 29 07:32:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Deleting instance files /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3_del
Nov 29 07:32:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Deletion of /opt/stack/data/nova/instances/fb883135-2995-4186-8251-42cae4bd57c3_del complete
Nov 29 07:32:33 user nova-compute[75373]: INFO nova.compute.manager [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 29 07:32:33 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:32:33 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance running successfully.
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Failed to set time: agent not configured {{(pid=75373) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 07:32:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-6d9fbbfd-8e2d-4b9b-a721-76606c2f04ef tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] finish_migration finished successfully. {{(pid=75373) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] No waiting events found dispatching network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:34 user nova-compute[75373]: WARNING nova.compute.manager [req-5ede3df5-6e62-480f-b750-3ab79ceb7852 req-91e5dcee-bdd9-42bc-acea-897ba8a89e32 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received unexpected event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 for instance with vm_state building and task_state spawning.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Instance spawned successfully.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Snapshot image upload complete
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.compute.manager [None req-22e37b17-b518-4a7f-bd95-8043b260a9d6 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Took 7.21 seconds to snapshot the instance on the hypervisor.
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.compute.manager [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Took 7.87 seconds to build instance.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b24-b8dd-45a8-a291-c7eb89dbd54d tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.010s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:34 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Took 1.32 seconds to deallocate network for instance.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] Acquiring lock "fb883135-2995-4186-8251-42cae4bd57c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] Lock "fb883135-2995-4186-8251-42cae4bd57c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] No waiting events found dispatching network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:34 user nova-compute[75373]: WARNING nova.compute.manager [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received unexpected event network-vif-plugged-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 for instance with vm_state deleted and task_state None.
Nov 29 07:32:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-c2bcd0ea-1e8a-42d8-af4c-2ef13b349952 req-9002cfe5-18e6-4364-bdc9-4f5b134582f5 service nova] [instance: fb883135-2995-4186-8251-42cae4bd57c3] Received event network-vif-deleted-bcb689a0-25f4-44c5-97a1-deb9e62d6ed8 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:35 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:35 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.832s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:35 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Deleted allocations for instance fb883135-2995-4186-8251-42cae4bd57c3
Nov 29 07:32:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-633de18c-b895-406f-bd5e-f63f28273823 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "fb883135-2995-4186-8251-42cae4bd57c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:37 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:32:37 user nova-compute[75373]: INFO nova.compute.claims [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Claim successful on node user
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:32:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:32:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.policy [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09780199e5494517ade9171aeaa5eae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc5739c33ed4c0ab7cd0f16a62eb0af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:32:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Creating image(s)
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "/opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "/opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "/opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:32:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Successfully created port: 3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:32:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG nova.virt.images [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] 6a967996-5aad-4201-b6ec-2d9098446917 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.part /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.part /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.converted" returned: 0 in 0.385s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.087s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json" returned: 0 in 0.233s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Successfully updated port: 3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquired lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing instance network info cache due to event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] Acquiring lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84,backing_fmt=raw /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84,backing_fmt=raw /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk 1073741824" returned: 0 in 0.071s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "29b8cfdaba0a0c985bf64d9954e466e64ee3fb84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Ensure instance console log exists: /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating instance_info_cache with network_info: [{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Releasing lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Instance network_info: |[{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] Acquired lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Start _get_guest_xml network_info=[{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e4288c2b707bf6e5d7cbc8200cca3020',container_format='bare',created_at=2023-11-29T07:32:27Z,direct_url=<?>,disk_format='qcow2',id=6a967996-5aad-4201-b6ec-2d9098446917,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-297504164',owner='2fc5739c33ed4c0ab7cd0f16a62eb0af',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:32:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6a967996-5aad-4201-b6ec-2d9098446917'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:32:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e4288c2b707bf6e5d7cbc8200cca3020',container_format='bare',created_at=2023-11-29T07:32:27Z,direct_url=<?>,disk_format='qcow2',id=6a967996-5aad-4201-b6ec-2d9098446917,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-297504164',owner='2fc5739c33ed4c0ab7cd0f16a62eb0af',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:32:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1783713197',display_name='tempest-TestStampPattern-server-1783713197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1783713197',id=29,image_ref='6a967996-5aad-4201-b6ec-2d9098446917',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-6p07rjm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae9d3db8-d3ac-4cfc-81ac-e585aeb53338',image_min_disk='1',image_min_ram='0',image_owner_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',image_owner_project_name='tempest-TestStampPattern-110582567',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-110582567-project-member',image_user_id='09780199e5494517ade9171aeaa5eae3',network_allocated='True',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:38Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=744afb31-138f-4b63-aacb-729b922548d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.objects.instance [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'pci_devices' on Instance uuid 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:32:41 user nova-compute[75373]:   <uuid>744afb31-138f-4b63-aacb-729b922548d6</uuid>
Nov 29 07:32:41 user nova-compute[75373]:   <name>instance-0000001d</name>
Nov 29 07:32:41 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:32:41 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:32:41 user nova-compute[75373]:   <metadata>
Nov 29 07:32:41 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:32:41 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:name>tempest-TestStampPattern-server-1783713197</nova:name>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:32:41</nova:creationTime>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:32:41 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:32:41 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:owner>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:user uuid="09780199e5494517ade9171aeaa5eae3">tempest-TestStampPattern-110582567-project-member</nova:user>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:project uuid="2fc5739c33ed4c0ab7cd0f16a62eb0af">tempest-TestStampPattern-110582567</nova:project>
Nov 29 07:32:41 user nova-compute[75373]:       </nova:owner>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:root type="image" uuid="6a967996-5aad-4201-b6ec-2d9098446917"/>
Nov 29 07:32:41 user nova-compute[75373]:       <nova:ports>
Nov 29 07:32:41 user nova-compute[75373]:         <nova:port uuid="3e629323-c230-4549-a8f4-c7a0b55c4f78">
Nov 29 07:32:41 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:32:41 user nova-compute[75373]:         </nova:port>
Nov 29 07:32:41 user nova-compute[75373]:       </nova:ports>
Nov 29 07:32:41 user nova-compute[75373]:     </nova:instance>
Nov 29 07:32:41 user nova-compute[75373]:   </metadata>
Nov 29 07:32:41 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:32:41 user nova-compute[75373]:     <system>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="serial">744afb31-138f-4b63-aacb-729b922548d6</entry>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="uuid">744afb31-138f-4b63-aacb-729b922548d6</entry>
Nov 29 07:32:41 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:32:41 user nova-compute[75373]:     </system>
Nov 29 07:32:41 user nova-compute[75373]:   </sysinfo>
Nov 29 07:32:41 user nova-compute[75373]:   <os>
Nov 29 07:32:41 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:32:41 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:32:41 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:32:41 user nova-compute[75373]:   </os>
Nov 29 07:32:41 user nova-compute[75373]:   <features>
Nov 29 07:32:41 user nova-compute[75373]:     <acpi/>
Nov 29 07:32:41 user nova-compute[75373]:     <apic/>
Nov 29 07:32:41 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:32:41 user nova-compute[75373]:   </features>
Nov 29 07:32:41 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:32:41 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:32:41 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:32:41 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:32:41 user nova-compute[75373]:   </clock>
Nov 29 07:32:41 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:32:41 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:32:41 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:32:41 user nova-compute[75373]:   </cpu>
Nov 29 07:32:41 user nova-compute[75373]:   <devices>
Nov 29 07:32:41 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:32:41 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:32:41 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk"/>
Nov 29 07:32:41 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:32:41 user nova-compute[75373]:     </disk>
Nov 29 07:32:41 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:32:41 user nova-compute[75373]:       <mac address="fa:16:3e:2d:a2:6e"/>
Nov 29 07:32:41 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:41 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:32:41 user nova-compute[75373]:       <target dev="tap3e629323-c2"/>
Nov 29 07:32:41 user nova-compute[75373]:     </interface>
Nov 29 07:32:41 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:32:41 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/console.log" append="off"/>
Nov 29 07:32:41 user nova-compute[75373]:     </serial>
Nov 29 07:32:41 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:32:41 user nova-compute[75373]:     <video>
Nov 29 07:32:41 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:41 user nova-compute[75373]:     </video>
Nov 29 07:32:41 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:32:41 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:32:41 user nova-compute[75373]:     </rng>
Nov 29 07:32:41 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:32:41 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:32:41 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:32:41 user nova-compute[75373]:     </memballoon>
Nov 29 07:32:41 user nova-compute[75373]:   </devices>
Nov 29 07:32:41 user nova-compute[75373]: </domain>
Nov 29 07:32:41 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1783713197',display_name='tempest-TestStampPattern-server-1783713197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1783713197',id=29,image_ref='6a967996-5aad-4201-b6ec-2d9098446917',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-6p07rjm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae9d3db8-d3ac-4cfc-81ac-e585aeb53338',image_min_disk='1',image_min_ram='0',image_owner_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',image_owner_project_name='tempest-TestStampPattern-110582567',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-110582567-project-member',image_user_id='09780199e5494517ade9171aeaa5eae3',network_allocated='True',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:38Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=744afb31-138f-4b63-aacb-729b922548d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG os_vif [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7407ddbf-936f-5cbb-be5c-2b87a0e5b911', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e629323-c2, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e629323-c2, col_values=(('qos', UUID('57fe4243-b2c9-4f87-aa78-8fafba8f3a9c')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e629323-c2, col_values=(('external_ids', {'iface-id': '3e629323-c230-4549-a8f4-c7a0b55c4f78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:a2:6e', 'vm-uuid': '744afb31-138f-4b63-aacb-729b922548d6'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:41 user nova-compute[75373]: INFO os_vif [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2')
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No VIF found with MAC fa:16:3e:2d:a2:6e, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updated VIF entry in instance network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG nova.network.neutron [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating instance_info_cache with network_info: [{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0af7c0fb-784b-49f9-8686-731988613f50 req-b34623a7-5b79-4e23-a0d6-4aa05c4324b8 service nova] Releasing lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:42 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:32:42 user nova-compute[75373]: INFO nova.compute.claims [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Claim successful on node user
Nov 29 07:32:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] No waiting events found dispatching network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:43 user nova-compute[75373]: WARNING nova.compute.manager [req-b1e85d8c-1ca8-4a56-b76d-867748ac35c0 req-b47294e4-fe3c-476c-b9e0-8c22e1e02f8b service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received unexpected event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 for instance with vm_state building and task_state spawning.
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:32:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.policy [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd3d603a0cab4a7da1c743c26b73540d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f10657321e44f49a30fedbe20dddcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:32:43 user nova-compute[75373]: INFO nova.virt.block_device [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Booting with volume 81fb0c39-194f-411c-bd10-df1ce47e0dbf at /dev/vda
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.utils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e5ebf-9dfc-4347-89d3-4653dbd874bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef192d-768e-4f74-88c2-0fcb68b12794]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb104ab-d681-41cd-94f5-c39025fdc41f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17856a9-c636-4564-b64e-a3bd63792847]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:32:43 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:32:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da4003-a93f-4da3-94fb-828554bffce5]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG os_brick.utils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:43 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating existing volume attachment record: 4728c61d-20d5-4abf-bf11-f7d26960b758 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Successfully created port: 2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Successfully updated port: 2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:32:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-changed-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Refreshing instance network info cache due to event network-changed-2f1e556a-b9d0-480b-9b30-c6335010a583. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] No waiting events found dispatching network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:45 user nova-compute[75373]: WARNING nova.compute.manager [req-635b05c6-70c2-4367-a74c-852b07864787 req-28332854-68fe-46e7-949f-b1f7af92ad93 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received unexpected event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 for instance with vm_state building and task_state spawning.
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:32:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Instance spawned successfully.
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance network_info: |[{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.network.neutron [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Refreshing network info cache for port 2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:45 user nova-compute[75373]: INFO nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:45 user nova-compute[75373]: INFO nova.compute.manager [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Took 8.15 seconds to build instance.
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-55e116c0-3230-48b9-b2f6-f1e9c89af794 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.277s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG nova.network.neutron [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updated VIF entry in instance network info cache for port 2f1e556a-b9d0-480b-9b30-c6335010a583. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG nova.network.neutron [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1eca2820-eaa2-4b22-b733-a87c0fdf40cf req-b26a5ee5-0b14-4d31-9668-064cf38f8b06 service nova] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:32:50 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:50 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=24.96511459350586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Applying migration context for instance f44b466e-2b87-414a-a4f7-d951d0a015c3 as it has an incoming, in-progress migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28. Migration status is finished {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 07:32:50 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating resource usage from migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69653ee0-5044-45da-ac6a-407d4cc66740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 744afb31-138f-4b63-aacb-729b922548d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:50 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:32:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:32:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:32:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:32:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Creating image(s)
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Ensure instance console log exists: /opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start _get_guest_xml network_info=[{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b65cbd1b-d24b-4fc1-91e0-57135fbc5aee', 'attached_at': '', 'detached_at': '', 'volume_id': '81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'serial': '81fb0c39-194f-411c-bd10-df1ce47e0dbf'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4728c61d-20d5-4abf-bf11-f7d26960b758', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:32:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:32:52 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:52 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:32:52 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5a356-2e0b-4456-a4cb-223abd52fef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:32:52 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408f4a4-3342-4954-b2db-4976f3b18924]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf] added
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea1051-b747-4774-930c-75d17b6cae2e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e89df-ff8a-40c5-b6ee-b1905b60cc6a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zunNDFeK {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zunNDFeK" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea7c3ad-1053-4b47-8c42-8d3d26ce7d90]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zunNDFeK'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3437b83-56e5-40dd-b1fd-916139969046]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ba6d9-3de8-4df8-a6f8-d04032e102c6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ffe0c9-abf5-4fb3-9298-b571b79419f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]
Nov 29 07:32:52 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51680324-2595-4458-85b8-81585063ba5f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49dde3d-cc7d-4335-9686-d7751eb093b0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:32:52 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:32:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9a408-5250-44d6-a77d-dbfc76f4f777]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:32:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:32:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:32:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:32:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:32:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26138396431373835', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:32:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138396431373835', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'pci_devices' on Instance uuid b65cbd1b-d24b-4fc1-91e0-57135fbc5aee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:32:54 user nova-compute[75373]:   <uuid>b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</uuid>
Nov 29 07:32:54 user nova-compute[75373]:   <name>instance-0000001e</name>
Nov 29 07:32:54 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:32:54 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:32:54 user nova-compute[75373]:   <metadata>
Nov 29 07:32:54 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:32:54 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:32:54 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherA-server-45594249</nova:name>
Nov 29 07:32:54 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:32:52</nova:creationTime>
Nov 29 07:32:54 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:32:54 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:32:54 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:32:54 user nova-compute[75373]:       <nova:owner>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:user uuid="fd3d603a0cab4a7da1c743c26b73540d">tempest-ServerActionsTestOtherA-1926007529-project-member</nova:user>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:project uuid="b3f10657321e44f49a30fedbe20dddcf">tempest-ServerActionsTestOtherA-1926007529</nova:project>
Nov 29 07:32:54 user nova-compute[75373]:       </nova:owner>
Nov 29 07:32:54 user nova-compute[75373]:       <nova:ports>
Nov 29 07:32:54 user nova-compute[75373]:         <nova:port uuid="2f1e556a-b9d0-480b-9b30-c6335010a583">
Nov 29 07:32:54 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:32:54 user nova-compute[75373]:         </nova:port>
Nov 29 07:32:54 user nova-compute[75373]:       </nova:ports>
Nov 29 07:32:54 user nova-compute[75373]:     </nova:instance>
Nov 29 07:32:54 user nova-compute[75373]:   </metadata>
Nov 29 07:32:54 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:32:54 user nova-compute[75373]:     <system>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="serial">b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</entry>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="uuid">b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</entry>
Nov 29 07:32:54 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:32:54 user nova-compute[75373]:     </system>
Nov 29 07:32:54 user nova-compute[75373]:   </sysinfo>
Nov 29 07:32:54 user nova-compute[75373]:   <os>
Nov 29 07:32:54 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:32:54 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:32:54 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:32:54 user nova-compute[75373]:   </os>
Nov 29 07:32:54 user nova-compute[75373]:   <features>
Nov 29 07:32:54 user nova-compute[75373]:     <acpi/>
Nov 29 07:32:54 user nova-compute[75373]:     <apic/>
Nov 29 07:32:54 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:32:54 user nova-compute[75373]:   </features>
Nov 29 07:32:54 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:32:54 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:32:54 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:32:54 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:32:54 user nova-compute[75373]:   </clock>
Nov 29 07:32:54 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:32:54 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:32:54 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:32:54 user nova-compute[75373]:   </cpu>
Nov 29 07:32:54 user nova-compute[75373]:   <devices>
Nov 29 07:32:54 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:32:54 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:32:54 user nova-compute[75373]:       <source dev="/dev/sde"/>
Nov 29 07:32:54 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:32:54 user nova-compute[75373]:       <serial>81fb0c39-194f-411c-bd10-df1ce47e0dbf</serial>
Nov 29 07:32:54 user nova-compute[75373]:     </disk>
Nov 29 07:32:54 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:32:54 user nova-compute[75373]:       <mac address="fa:16:3e:ac:25:31"/>
Nov 29 07:32:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:54 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:32:54 user nova-compute[75373]:       <target dev="tap2f1e556a-b9"/>
Nov 29 07:32:54 user nova-compute[75373]:     </interface>
Nov 29 07:32:54 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:32:54 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee/console.log" append="off"/>
Nov 29 07:32:54 user nova-compute[75373]:     </serial>
Nov 29 07:32:54 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:32:54 user nova-compute[75373]:     <video>
Nov 29 07:32:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:32:54 user nova-compute[75373]:     </video>
Nov 29 07:32:54 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:32:54 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:32:54 user nova-compute[75373]:     </rng>
Nov 29 07:32:54 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:32:54 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:32:54 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:32:54 user nova-compute[75373]:     </memballoon>
Nov 29 07:32:54 user nova-compute[75373]:   </devices>
Nov 29 07:32:54 user nova-compute[75373]: </domain>
Nov 29 07:32:54 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:32:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG os_vif [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0490a442-0b7e-58d7-b834-df89ad760f4e', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f1e556a-b9, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f1e556a-b9, col_values=(('qos', UUID('4384ded7-2c3f-426d-a47e-cbdb74cde81f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f1e556a-b9, col_values=(('external_ids', {'iface-id': '2f1e556a-b9d0-480b-9b30-c6335010a583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:25:31', 'vm-uuid': 'b65cbd1b-d24b-4fc1-91e0-57135fbc5aee'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:54 user nova-compute[75373]: INFO os_vif [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9')
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:32:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No VIF found with MAC fa:16:3e:ac:25:31, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:55 user nova-compute[75373]: WARNING nova.compute.manager [req-efbf5ecc-8700-4edb-83e0-e16ee141585e req-b660134d-4e47-4ee5-9efa-7b1070fe8793 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state building and task_state spawning.
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:32:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance spawned successfully.
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:32:57 user nova-compute[75373]: WARNING nova.compute.manager [req-e1cdc9a5-f94b-4090-bbcb-73f77e60fe44 req-44b1242c-d0ea-43bd-8021-57200f10cf41 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state building and task_state spawning.
Nov 29 07:32:57 user nova-compute[75373]: INFO nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 29 07:32:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:32:57 user nova-compute[75373]: INFO nova.compute.manager [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Took 15.14 seconds to build instance.
Nov 29 07:32:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0987cb21-df62-4ad6-aed7-bdf1c2a654a4 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.255s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:32:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:14 user nova-compute[75373]: INFO nova.compute.manager [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Unrescuing
Nov 29 07:33:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'flavor' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:15 user nova-compute[75373]: WARNING nova.compute.manager [req-be740dee-6382-4652-b41e-961d24762900 req-c5d8f11e-9ea6-4812-8442-9c242d5b574d service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'info_cache' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance destroyed successfully.
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance destroyed successfully.
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'resources' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG os_vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap825d3fb3-d4, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08c31fc8-c147-4e3c-9fec-c14556c24a0f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:15 user nova-compute[75373]: INFO os_vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start _get_guest_xml network_info=[{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'numa_topology' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:15 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:15 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:33:15 user nova-compute[75373]:   <uuid>5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</uuid>
Nov 29 07:33:15 user nova-compute[75373]:   <name>instance-00000012</name>
Nov 29 07:33:15 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:33:15 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:33:15 user nova-compute[75373]:   <metadata>
Nov 29 07:33:15 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:33:15 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeTestJSON-server-770343245</nova:name>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:33:15</nova:creationTime>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:33:15 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:33:15 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:owner>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:user uuid="f571f40d066b4d198fcf6d49c22ad1c1">tempest-AttachVolumeTestJSON-1182766882-project-member</nova:user>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:project uuid="249771bcbe724be3ac7c15231dd07e45">tempest-AttachVolumeTestJSON-1182766882</nova:project>
Nov 29 07:33:15 user nova-compute[75373]:       </nova:owner>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:33:15 user nova-compute[75373]:       <nova:ports>
Nov 29 07:33:15 user nova-compute[75373]:         <nova:port uuid="825d3fb3-d49c-4814-82e1-30be81642c31">
Nov 29 07:33:15 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:33:15 user nova-compute[75373]:         </nova:port>
Nov 29 07:33:15 user nova-compute[75373]:       </nova:ports>
Nov 29 07:33:15 user nova-compute[75373]:     </nova:instance>
Nov 29 07:33:15 user nova-compute[75373]:   </metadata>
Nov 29 07:33:15 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:33:15 user nova-compute[75373]:     <system>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="serial">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="uuid">5bfdfeb1-6da4-4f38-8c3d-ea1af1222680</entry>
Nov 29 07:33:15 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:33:15 user nova-compute[75373]:     </system>
Nov 29 07:33:15 user nova-compute[75373]:   </sysinfo>
Nov 29 07:33:15 user nova-compute[75373]:   <os>
Nov 29 07:33:15 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:33:15 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:33:15 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:33:15 user nova-compute[75373]:   </os>
Nov 29 07:33:15 user nova-compute[75373]:   <features>
Nov 29 07:33:15 user nova-compute[75373]:     <acpi/>
Nov 29 07:33:15 user nova-compute[75373]:     <apic/>
Nov 29 07:33:15 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:33:15 user nova-compute[75373]:   </features>
Nov 29 07:33:15 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:33:15 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:33:15 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:33:15 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:33:15 user nova-compute[75373]:   </clock>
Nov 29 07:33:15 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:33:15 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:33:15 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:33:15 user nova-compute[75373]:   </cpu>
Nov 29 07:33:15 user nova-compute[75373]:   <devices>
Nov 29 07:33:15 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:33:15 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:33:15 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk"/>
Nov 29 07:33:15 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:33:15 user nova-compute[75373]:     </disk>
Nov 29 07:33:15 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:33:15 user nova-compute[75373]:       <mac address="fa:16:3e:c9:28:6e"/>
Nov 29 07:33:15 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:15 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:33:15 user nova-compute[75373]:       <target dev="tap825d3fb3-d4"/>
Nov 29 07:33:15 user nova-compute[75373]:     </interface>
Nov 29 07:33:15 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:33:15 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/console.log" append="off"/>
Nov 29 07:33:15 user nova-compute[75373]:     </serial>
Nov 29 07:33:15 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:33:15 user nova-compute[75373]:     <video>
Nov 29 07:33:15 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:15 user nova-compute[75373]:     </video>
Nov 29 07:33:15 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:33:15 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:33:15 user nova-compute[75373]:     </rng>
Nov 29 07:33:15 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:33:15 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:33:15 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:33:15 user nova-compute[75373]:     </memballoon>
Nov 29 07:33:15 user nova-compute[75373]:   </devices>
Nov 29 07:33:15 user nova-compute[75373]: </domain>
Nov 29 07:33:15 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Cannot resize image /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'migration_context' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.objects.base [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Object Instance<5bfdfeb1-6da4-4f38-8c3d-ea1af1222680> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:31:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG os_vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '475d8446-9b98-5d5e-8885-926c75a1355c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap825d3fb3-d4, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap825d3fb3-d4, col_values=(('qos', UUID('bb49485b-123f-431b-a683-0b5928f7d990')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap825d3fb3-d4, col_values=(('external_ids', {'iface-id': '825d3fb3-d49c-4814-82e1-30be81642c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:28:6e', 'vm-uuid': '5bfdfeb1-6da4-4f38-8c3d-ea1af1222680'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: INFO os_vif [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:17 user nova-compute[75373]: WARNING nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:33:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:17 user nova-compute[75373]: WARNING nova.compute.manager [req-7c90d0c3-d7aa-4425-a5da-aa887927d344 req-cbd6cd01-b906-4756-8e61-555f3967cbc7 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:33:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:19 user nova-compute[75373]: WARNING nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:19 user nova-compute[75373]: WARNING nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state powering-on.
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:19 user nova-compute[75373]: WARNING nova.compute.manager [req-97e53fc7-793c-4d56-80b4-a69bcff8d932 req-6ed1b46c-fc53-432e-8f0e-642fadb6fc27 service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state stopped and task_state powering-on.
Nov 29 07:33:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a1c4211f-8b14-4841-ab1e-08328ebc232e tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:33:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:33:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance rebooted successfully.
Nov 29 07:33:20 user nova-compute[75373]: DEBUG nova.compute.manager [None req-588c84db-de13-4837-9870-c3dc834006fa tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:33:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:33:26 user nova-compute[75373]: INFO nova.compute.claims [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Claim successful on node user
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.254s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:33:26 user nova-compute[75373]: INFO nova.compute.claims [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Claim successful on node user
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:33:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:33:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.policy [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d67f374467c43e1b247a4fbc69e67d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb2c66f2ee4df08d54238965f90bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:33:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Creating image(s)
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk 1073741824" returned: 0 in 0.060s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Successfully created port: 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.policy [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7dec6d7789c4430ad19e175de4b3519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff517549ee99421aa0e9d570d4fb6941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Cannot resize image /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Ensure instance console log exists: /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:33:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Creating image(s)
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "/opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Successfully updated port: 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Successfully created port: c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk 1073741824" returned: 0 in 0.067s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing instance network info cache due to event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Cannot resize image /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Ensure instance console log exists: /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance network_info: |[{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.neutron [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start _get_guest_xml network_info=[{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:33:28 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:28 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZLW/8UHXJjA1ttw+Y8X7Z/m4nn+EiW4I7qaqgAtvuvUTc2reY5VvUEYdvx3LoaaLitBNrr2eCoxiBLerCPFCdeR7MQMq0f01D4FIcD8AzuWNQNas1YNDG1kwGx3n2Qg==',key_name='tempest-keypair-586193429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:33:28 user nova-compute[75373]:   <uuid>4aa9a315-093e-44d7-8574-dcc3230b5479</uuid>
Nov 29 07:33:28 user nova-compute[75373]:   <name>instance-0000001f</name>
Nov 29 07:33:28 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:33:28 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:33:28 user nova-compute[75373]:   <metadata>
Nov 29 07:33:28 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:33:28 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-517026649</nova:name>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:33:28</nova:creationTime>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:33:28 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:33:28 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:owner>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:user uuid="6d67f374467c43e1b247a4fbc69e67d0">tempest-AttachVolumeShelveTestJSON-1812012148-project-member</nova:user>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:project uuid="c7fb2c66f2ee4df08d54238965f90bc6">tempest-AttachVolumeShelveTestJSON-1812012148</nova:project>
Nov 29 07:33:28 user nova-compute[75373]:       </nova:owner>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:33:28 user nova-compute[75373]:       <nova:ports>
Nov 29 07:33:28 user nova-compute[75373]:         <nova:port uuid="9d1d3229-da55-4194-89a0-3ad8b6a21c0d">
Nov 29 07:33:28 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:33:28 user nova-compute[75373]:         </nova:port>
Nov 29 07:33:28 user nova-compute[75373]:       </nova:ports>
Nov 29 07:33:28 user nova-compute[75373]:     </nova:instance>
Nov 29 07:33:28 user nova-compute[75373]:   </metadata>
Nov 29 07:33:28 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:33:28 user nova-compute[75373]:     <system>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="serial">4aa9a315-093e-44d7-8574-dcc3230b5479</entry>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="uuid">4aa9a315-093e-44d7-8574-dcc3230b5479</entry>
Nov 29 07:33:28 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:33:28 user nova-compute[75373]:     </system>
Nov 29 07:33:28 user nova-compute[75373]:   </sysinfo>
Nov 29 07:33:28 user nova-compute[75373]:   <os>
Nov 29 07:33:28 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:33:28 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:33:28 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:33:28 user nova-compute[75373]:   </os>
Nov 29 07:33:28 user nova-compute[75373]:   <features>
Nov 29 07:33:28 user nova-compute[75373]:     <acpi/>
Nov 29 07:33:28 user nova-compute[75373]:     <apic/>
Nov 29 07:33:28 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:33:28 user nova-compute[75373]:   </features>
Nov 29 07:33:28 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:33:28 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:33:28 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:33:28 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:33:28 user nova-compute[75373]:   </clock>
Nov 29 07:33:28 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:33:28 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:33:28 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:33:28 user nova-compute[75373]:   </cpu>
Nov 29 07:33:28 user nova-compute[75373]:   <devices>
Nov 29 07:33:28 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:33:28 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:33:28 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk"/>
Nov 29 07:33:28 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:33:28 user nova-compute[75373]:     </disk>
Nov 29 07:33:28 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:33:28 user nova-compute[75373]:       <mac address="fa:16:3e:cd:bd:31"/>
Nov 29 07:33:28 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:28 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:33:28 user nova-compute[75373]:       <target dev="tap9d1d3229-da"/>
Nov 29 07:33:28 user nova-compute[75373]:     </interface>
Nov 29 07:33:28 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:33:28 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/console.log" append="off"/>
Nov 29 07:33:28 user nova-compute[75373]:     </serial>
Nov 29 07:33:28 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:33:28 user nova-compute[75373]:     <video>
Nov 29 07:33:28 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:28 user nova-compute[75373]:     </video>
Nov 29 07:33:28 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:33:28 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:33:28 user nova-compute[75373]:     </rng>
Nov 29 07:33:28 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:33:28 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:33:28 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:33:28 user nova-compute[75373]:     </memballoon>
Nov 29 07:33:28 user nova-compute[75373]:   </devices>
Nov 29 07:33:28 user nova-compute[75373]: </domain>
Nov 29 07:33:28 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZLW/8UHXJjA1ttw+Y8X7Z/m4nn+EiW4I7qaqgAtvuvUTc2reY5VvUEYdvx3LoaaLitBNrr2eCoxiBLerCPFCdeR7MQMq0f01D4FIcD8AzuWNQNas1YNDG1kwGx3n2Qg==',key_name='tempest-keypair-586193429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG os_vif [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c596fa8e-c38f-5b7d-82ba-8106cee01c7c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d1d3229-da, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d1d3229-da, col_values=(('qos', UUID('a2d9b8e0-5a6e-4aa5-9695-10c1c507dc7f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d1d3229-da, col_values=(('external_ids', {'iface-id': '9d1d3229-da55-4194-89a0-3ad8b6a21c0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:bd:31', 'vm-uuid': '4aa9a315-093e-44d7-8574-dcc3230b5479'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: INFO os_vif [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da')
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Successfully updated port: c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No VIF found with MAC fa:16:3e:cd:bd:31, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-changed-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Refreshing instance network info cache due to event network-changed-c91cc7eb-7190-43a8-986d-832534764c09. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] Acquiring lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updated VIF entry in instance network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-433032ab-f59d-4e13-90ca-25024c7065c2 req-f4784156-cdea-44d7-9487-78e2150a7116 service nova] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updating instance_info_cache with network_info: [{"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Instance network_info: |[{"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] Acquired lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Refreshing network info cache for port c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Start _get_guest_xml network_info=[{"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:33:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:29 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377946000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377946000',id=32,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-ksimmmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:33:28Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=201b9ba5-fa23-4c43-8ca7-b55093c7b643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid 201b9ba5-fa23-4c43-8ca7-b55093c7b643 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:33:29 user nova-compute[75373]:   <uuid>201b9ba5-fa23-4c43-8ca7-b55093c7b643</uuid>
Nov 29 07:33:29 user nova-compute[75373]:   <name>instance-00000020</name>
Nov 29 07:33:29 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:33:29 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:33:29 user nova-compute[75373]:   <metadata>
Nov 29 07:33:29 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:33:29 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-377946000</nova:name>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:33:29</nova:creationTime>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:33:29 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:33:29 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:owner>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:33:29 user nova-compute[75373]:       </nova:owner>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:33:29 user nova-compute[75373]:       <nova:ports>
Nov 29 07:33:29 user nova-compute[75373]:         <nova:port uuid="c91cc7eb-7190-43a8-986d-832534764c09">
Nov 29 07:33:29 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:33:29 user nova-compute[75373]:         </nova:port>
Nov 29 07:33:29 user nova-compute[75373]:       </nova:ports>
Nov 29 07:33:29 user nova-compute[75373]:     </nova:instance>
Nov 29 07:33:29 user nova-compute[75373]:   </metadata>
Nov 29 07:33:29 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:33:29 user nova-compute[75373]:     <system>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="serial">201b9ba5-fa23-4c43-8ca7-b55093c7b643</entry>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="uuid">201b9ba5-fa23-4c43-8ca7-b55093c7b643</entry>
Nov 29 07:33:29 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:33:29 user nova-compute[75373]:     </system>
Nov 29 07:33:29 user nova-compute[75373]:   </sysinfo>
Nov 29 07:33:29 user nova-compute[75373]:   <os>
Nov 29 07:33:29 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:33:29 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:33:29 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:33:29 user nova-compute[75373]:   </os>
Nov 29 07:33:29 user nova-compute[75373]:   <features>
Nov 29 07:33:29 user nova-compute[75373]:     <acpi/>
Nov 29 07:33:29 user nova-compute[75373]:     <apic/>
Nov 29 07:33:29 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:33:29 user nova-compute[75373]:   </features>
Nov 29 07:33:29 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:33:29 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:33:29 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:33:29 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:33:29 user nova-compute[75373]:   </clock>
Nov 29 07:33:29 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:33:29 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:33:29 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:33:29 user nova-compute[75373]:   </cpu>
Nov 29 07:33:29 user nova-compute[75373]:   <devices>
Nov 29 07:33:29 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:33:29 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:33:29 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk"/>
Nov 29 07:33:29 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:33:29 user nova-compute[75373]:     </disk>
Nov 29 07:33:29 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:33:29 user nova-compute[75373]:       <mac address="fa:16:3e:13:a1:d9"/>
Nov 29 07:33:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:29 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:33:29 user nova-compute[75373]:       <target dev="tapc91cc7eb-71"/>
Nov 29 07:33:29 user nova-compute[75373]:     </interface>
Nov 29 07:33:29 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:33:29 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/console.log" append="off"/>
Nov 29 07:33:29 user nova-compute[75373]:     </serial>
Nov 29 07:33:29 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:33:29 user nova-compute[75373]:     <video>
Nov 29 07:33:29 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:33:29 user nova-compute[75373]:     </video>
Nov 29 07:33:29 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:33:29 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:33:29 user nova-compute[75373]:     </rng>
Nov 29 07:33:29 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:33:29 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:33:29 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:33:29 user nova-compute[75373]:     </memballoon>
Nov 29 07:33:29 user nova-compute[75373]:   </devices>
Nov 29 07:33:29 user nova-compute[75373]: </domain>
Nov 29 07:33:29 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377946000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377946000',id=32,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-ksimmmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:33:28Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=201b9ba5-fa23-4c43-8ca7-b55093c7b643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG os_vif [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5192aed-956c-56b8-a5dc-11ed106eaa09', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc91cc7eb-71, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc91cc7eb-71, col_values=(('qos', UUID('82e925a3-959f-4d25-929d-570373f70263')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc91cc7eb-71, col_values=(('external_ids', {'iface-id': 'c91cc7eb-7190-43a8-986d-832534764c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a1:d9', 'vm-uuid': '201b9ba5-fa23-4c43-8ca7-b55093c7b643'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:29 user nova-compute[75373]: INFO os_vif [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71')
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:13:a1:d9, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updated VIF entry in instance network info cache for port c91cc7eb-7190-43a8-986d-832534764c09. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updating instance_info_cache with network_info: [{"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-96b2495f-1f80-46ac-8fa8-456b8687f42e req-75c06ed4-19e9-46ef-8270-de597d0c9551 service nova] Releasing lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:31 user nova-compute[75373]: WARNING nova.compute.manager [req-ca2cd1ba-9951-472a-91a6-aa96f4b6f8da req-d8b53192-79ea-4cf4-b328-c98b5e00761e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state building and task_state spawning.
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:33 user nova-compute[75373]: WARNING nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state building and task_state spawning.
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] No waiting events found dispatching network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:33 user nova-compute[75373]: WARNING nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received unexpected event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 for instance with vm_state building and task_state spawning.
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] No waiting events found dispatching network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:33:33 user nova-compute[75373]: WARNING nova.compute.manager [req-e99ee507-2520-4318-87e6-1f7c44e23cb9 req-0ed6f4c8-bee8-40b6-9015-a3dfa6fa3ff2 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received unexpected event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 for instance with vm_state building and task_state spawning.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Instance spawned successfully.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance spawned successfully.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:33:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Took 7.42 seconds to spawn the instance on the hypervisor.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.compute.manager [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Took 8.56 seconds to build instance.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b0d402b5-91f8-4088-b31e-1b02e78f62e0 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.674s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:34 user nova-compute[75373]: INFO nova.compute.manager [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Took 8.26 seconds to build instance.
Nov 29 07:33:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4b6ec12a-6acd-410c-ae6a-6c4e5cf05eb7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.367s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:39 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:33:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:33:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [{"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:33:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:33:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:33:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:45 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:33:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:33:46 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:33:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:33:52 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=6865MB free_disk=24.920825958251953GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:33:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Applying migration context for instance f44b466e-2b87-414a-a4f7-d951d0a015c3 as it has an incoming, in-progress migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28. Migration status is finished {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 07:33:53 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating resource usage from migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69653ee0-5044-45da-ac6a-407d4cc66740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 744afb31-138f-4b63-aacb-729b922548d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4aa9a315-093e-44d7-8574-dcc3230b5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:33:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:33:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:33:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:33:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Port 68cb76a9-e30c-4470-97d6-9e028490a7fe binding to destination host user is already ACTIVE {{(pid=75373) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Creating tmpfile /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/tmpl9bad7sb to verify with other compute node that the instance is on the same shared storage. {{(pid=75373) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:02 user nova-compute[75373]: WARNING nova.compute.manager [req-8fb6e6cc-61fd-4d77-9ce7-5fda1441497b req-b94f3ad7-063c-4f80-b633-6bab00f1cefe service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state resized and task_state resize_reverting.
Nov 29 07:34:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance destroyed successfully.
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'resources' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68cb76a9-e3, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee996e2a-a3a4-44fb-bd8e-3e0659405b2c) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:02 user nova-compute[75373]: INFO os_vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fba182-c0f7-4e07-871a-5a53cd0ae2cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:34:02 user nova-compute[75373]: No targets found.
Nov 29 07:34:02 user nova-compute[75373]: iSNS:
Nov 29 07:34:02 user nova-compute[75373]: No targets found.
Nov 29 07:34:02 user nova-compute[75373]: STATIC:
Nov 29 07:34:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:34:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:34:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:34:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:34:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:02 user nova-compute[75373]: FIRMWARE:
Nov 29 07:34:02 user nova-compute[75373]: No targets found.
Nov 29 07:34:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:34:02 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:34:02 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138733b-39ec-4b00-851e-b61850a9ae57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdb8be0-0d7a-41d9-b4ec-70744b140169]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:02 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae033f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6afe4b-2757-4580-b4e1-7ed8ba95e80c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223edb9-66d6-4acf-801e-bb2c28ca0aea]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd3c46-cc3e-4f21-929f-c2ab69eba45e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[349df919-8d5d-4f9c-a564-0b3f0f6404c6]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62d96e9-c0a4-4463-b522-cee8d00db789]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[35566245-9292-4499-9de2-0414359010a3]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:34:02 user nova-compute[75373]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52da7f-d58d-49b8-8227-fc71fc49c588]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== disconnect_volume: return (317ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:34:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'migration_context' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:03 user nova-compute[75373]: DEBUG nova.objects.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Object Instance<f44b466e-2b87-414a-a4f7-d951d0a015c3> lazy-loaded attributes: resources,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:04 user nova-compute[75373]: WARNING nova.compute.manager [req-8190a6fa-ea0f-422e-a792-e63bfab5e942 req-f6fa6f41-65b0-46cc-bd01-bcaa6dfe8079 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state resized and task_state resize_reverting.
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.530s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:04 user nova-compute[75373]: INFO nova.compute.manager [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Swapping old allocation on dict_keys(['7470e514-a168-44fb-900f-165629289ced']) held by migration 23dc5521-d821-4a49-87cf-5e52ca8ecc28 for instance
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Overwriting current allocation {'allocations': {'7470e514-a168-44fb-900f-165629289ced': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': '4e613704433449d9a6db31215d1b6867', 'user_id': 'b4c03943036e49e3b5021c5784e42ed0', 'consumer_generation': 1} on consumer f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.utils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e198aeef-5160-451a-8b1e-df337ff6afed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867567f-9e2c-4da8-a43d-b71d48a7d524]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa2061-b324-483a-a40c-618bd517f83c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a16455-b764-4b9c-890f-804b6fe2dc97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:05 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:34:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b6849-4c72-4efd-8ba9-e8e27eea600f]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:34:05 user nova-compute[75373]: DEBUG os_brick.utils [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-changed-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Refreshing instance network info cache due to event network-changed-0b11f649-abec-4189-a9f0-42e0771eead0. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] Acquiring lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] Acquired lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Refreshing network info cache for port 0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Ignoring supplied device name: /dev/vdb
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updated VIF entry in instance network info cache for port 0b11f649-abec-4189-a9f0-42e0771eead0. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating instance_info_cache with network_info: [{"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-29826763-5c03-44d1-bfbb-af08c12e5d77 req-ffa1d0c3-c8ca-4adf-a487-a4d97cfb4fc5 service nova] Releasing lock "refresh_cache-69e4c87f-c3fa-44df-8abc-acdc84a179c0" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:06 user nova-compute[75373]: INFO nova.compute.manager [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Attaching volume 814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab to /dev/vdb
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.utils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d47f6-d28d-4094-98b0-12a1800f4fa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b18916-d88d-4b64-bbef-20db586c2759]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044b0d8-89fd-49b1-bc4d-036e048618ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[928416b8-9fb1-46ec-81d7-41943460c1d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:06 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:34:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cee2c9-e71d-4429-b8d5-334bb93d5431]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG os_brick.utils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:06 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating existing volume attachment record: 1da9b66c-3180-443e-a46b-c8358e24afd5 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:34:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Starting finish_revert_migration {{(pid=75373) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start _get_guest_xml network_info=[{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f44b466e-2b87-414a-a4f7-d951d0a015c3', 'attached_at': '2023-11-29T07:34:13.000000', 'detached_at': '', 'volume_id': '3de1f005-e019-463e-ad53-82c9095e62ef', 'serial': '3de1f005-e019-463e-ad53-82c9095e62ef'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '537aee9f-a846-406b-87ca-1e45700cbb80', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:34:13 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:13 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'vcpu_model' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:13 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:13 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:13 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ebddf-b216-42cd-b09e-8d4546e4bc05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:34:13 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05b1681-80f9-4ae5-8a17-8419673ccd93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef] added
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d369151-a20c-4881-96ba-20837aa44312]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b0272-b3af-4df2-ba41-a4d88b95e950]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWAwTYrh" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c734bbf-6660-494a-9737-3c8cb07cd64b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWAwTYrh'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7976b81d-ee3a-4688-b930-0aa8b00a2db8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[59366243-bebd-4095-aa61-b94257663881]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4af671-c867-49f9-b495-63dcf915d058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:34:13 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d841ef-4ccf-46cb-93fe-a472cd9ceab7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ede1b-79b8-477f-b305-7330cfbd5ea9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:13 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:13 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b77ddc-bd46-4851-87ad-3d223015ff88]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:13 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwMlOvnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:14 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373133643463', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.273s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:14 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:14 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16433f7e-d73a-4a1b-ae37-5d54687a8250]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:34:14 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:34:14 user nova-compute[75373]:   <uuid>f44b466e-2b87-414a-a4f7-d951d0a015c3</uuid>
Nov 29 07:34:14 user nova-compute[75373]:   <name>instance-00000018</name>
Nov 29 07:34:14 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:34:14 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:34:14 user nova-compute[75373]:   <metadata>
Nov 29 07:34:14 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:34:14 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherB-server-2127939767</nova:name>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:34:13</nova:creationTime>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:34:14 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:34:14 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:owner>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:user uuid="b4c03943036e49e3b5021c5784e42ed0">tempest-ServerActionsTestOtherB-1291056582-project-member</nova:user>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:project uuid="4e613704433449d9a6db31215d1b6867">tempest-ServerActionsTestOtherB-1291056582</nova:project>
Nov 29 07:34:14 user nova-compute[75373]:       </nova:owner>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:34:14 user nova-compute[75373]:       <nova:ports>
Nov 29 07:34:14 user nova-compute[75373]:         <nova:port uuid="68cb76a9-e30c-4470-97d6-9e028490a7fe">
Nov 29 07:34:14 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:34:14 user nova-compute[75373]:         </nova:port>
Nov 29 07:34:14 user nova-compute[75373]:       </nova:ports>
Nov 29 07:34:14 user nova-compute[75373]:     </nova:instance>
Nov 29 07:34:14 user nova-compute[75373]:   </metadata>
Nov 29 07:34:14 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:34:14 user nova-compute[75373]:     <system>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="serial">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="uuid">f44b466e-2b87-414a-a4f7-d951d0a015c3</entry>
Nov 29 07:34:14 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:34:14 user nova-compute[75373]:     </system>
Nov 29 07:34:14 user nova-compute[75373]:   </sysinfo>
Nov 29 07:34:14 user nova-compute[75373]:   <os>
Nov 29 07:34:14 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:34:14 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:34:14 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:34:14 user nova-compute[75373]:   </os>
Nov 29 07:34:14 user nova-compute[75373]:   <features>
Nov 29 07:34:14 user nova-compute[75373]:     <acpi/>
Nov 29 07:34:14 user nova-compute[75373]:     <apic/>
Nov 29 07:34:14 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:34:14 user nova-compute[75373]:   </features>
Nov 29 07:34:14 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:34:14 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:34:14 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:34:14 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:34:14 user nova-compute[75373]:   </clock>
Nov 29 07:34:14 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:34:14 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:34:14 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:34:14 user nova-compute[75373]:   </cpu>
Nov 29 07:34:14 user nova-compute[75373]:   <devices>
Nov 29 07:34:14 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:34:14 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:34:14 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk"/>
Nov 29 07:34:14 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:34:14 user nova-compute[75373]:     </disk>
Nov 29 07:34:14 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:34:14 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:14 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:34:14 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:34:14 user nova-compute[75373]:       <serial>3de1f005-e019-463e-ad53-82c9095e62ef</serial>
Nov 29 07:34:14 user nova-compute[75373]:     </disk>
Nov 29 07:34:14 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:34:14 user nova-compute[75373]:       <mac address="fa:16:3e:8f:df:fb"/>
Nov 29 07:34:14 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:34:14 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:34:14 user nova-compute[75373]:       <target dev="tap68cb76a9-e3"/>
Nov 29 07:34:14 user nova-compute[75373]:     </interface>
Nov 29 07:34:14 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:34:14 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/console.log" append="off"/>
Nov 29 07:34:14 user nova-compute[75373]:     </serial>
Nov 29 07:34:14 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:34:14 user nova-compute[75373]:     <video>
Nov 29 07:34:14 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:34:14 user nova-compute[75373]:     </video>
Nov 29 07:34:14 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:34:14 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:34:14 user nova-compute[75373]:     </rng>
Nov 29 07:34:14 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:34:14 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:34:14 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:34:14 user nova-compute[75373]:     </memballoon>
Nov 29 07:34:14 user nova-compute[75373]:   </devices>
Nov 29 07:34:14 user nova-compute[75373]: </domain>
Nov 29 07:34:14 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c5c4692-9b26-5ae2-91d0-02e064d8bbae', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68cb76a9-e3, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68cb76a9-e3, col_values=(('qos', UUID('306dad30-f07d-4ea6-ad6a-2b6c30bbadc9')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68cb76a9-e3, col_values=(('external_ids', {'iface-id': '68cb76a9-e30c-4470-97d6-9e028490a7fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:df:fb', 'vm-uuid': 'f44b466e-2b87-414a-a4f7-d951d0a015c3'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97a666d-52a4-42c4-a1b1-1ab54ea31b9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab] added
Nov 29 07:34:14 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:14 user nova-compute[75373]: INFO os_vif [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec65709-7386-4e38-9c98-6a18afb92acb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5fd1f8-b6bb-428e-9422-67370df33415]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwMlOvnd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LwMlOvnd" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[300207ef-803a-4af1-a5d2-471027b53cf9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LwMlOvnd'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d489ed4-eb50-4801-bb48-4dd5c431d12e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca3c083-58d2-4cb7-9b4f-8016d76e47b3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:14 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:14 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:14 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:14 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd0fb1-ff00-446a-a7f3-6546547abbf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260]
Nov 29 07:34:15 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6dd07-e88c-4933-af38-44528371ea75]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977faae-fe26-4bc8-a15d-032ade5a9549]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:15 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:15 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db55162f-b0cf-4e0d-8517-f9f13b481fd7]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwMlOvnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== connect_volume: return (1612ms) {'type': 'block', 'scsi_wwn': '26330383138383665', 'path': '/dev/sdf'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330383138383665', 'path': '/dev/sdf'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:34:16 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:16 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:34:16 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:16 user nova-compute[75373]:   <serial>814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab</serial>
Nov 29 07:34:16 user nova-compute[75373]: </disk>
Nov 29 07:34:16 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:16 user nova-compute[75373]: WARNING nova.compute.manager [req-b80f7eeb-1a7c-4213-aea7-bb0c6f02dc33 req-38924069-5b7e-4cf5-9f8d-4857afc678c4 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state resized and task_state resize_reverting.
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No VIF found with MAC fa:16:3e:82:c8:d1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:34:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38529cd9-2c0e-4c6d-be3a-908d4ecbff75 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.617s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-changed-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Refreshing instance network info cache due to event network-changed-d863c757-140b-46a8-8366-b155c1a33265. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] Acquiring lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] Acquired lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Refreshing network info cache for port d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updated VIF entry in instance network info cache for port d863c757-140b-46a8-8366-b155c1a33265. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updating instance_info_cache with network_info: [{"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-db1c08bf-c917-4c64-bfef-40bff445528e req-4a649e06-d47a-47e3-a42c-5d1f775e4fa1 service nova] Releasing lock "refresh_cache-69653ee0-5044-45da-ac6a-407d4cc66740" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:18 user nova-compute[75373]: WARNING nova.compute.manager [req-751854f6-e653-4405-9245-9967f6168174 req-72283162-091e-461b-ae6d-6aa68907a91b service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state resized and task_state resize_reverting.
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:34:18 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance running successfully.
Nov 29 07:34:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] finish_revert_migration finished successfully. {{(pid=75373) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 07:34:18 user nova-compute[75373]: INFO nova.compute.manager [None req-d877f93f-aa6d-4fc5-88b5-0de5963d7af6 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance to original state: 'active'
Nov 29 07:34:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:20 user nova-compute[75373]: INFO nova.compute.manager [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Attaching volume 9d09e019-f9e0-4830-8748-14e9af9d7d63 to /dev/vdb
Nov 29 07:34:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.utils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514ac56-69f3-4cb1-8639-aaebd1077504]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809b068-c5be-418a-be28-a88b5892b025]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c45a74-efc6-4fb5-8188-d7c8e6be1583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b7f3ee-d998-49ba-8fb7-4f52dea56e23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:20 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:34:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc160a0-35e6-483f-bd95-9f2b864cb723]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG os_brick.utils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:20 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updating existing volume attachment record: ba9b2b7c-e1f7-4bbf-b8b4-f99a5b8d6335 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:34:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFviRuEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:29 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:29 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:29 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b84f1-1ae0-4d86-a195-d67282ed618b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:34:29 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a25e6a-bb62-40d2-8828-5a666f2a7370]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63] added
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ac26b-6188-4246-9b1e-d9402ca560bf]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[27613b9e-777b-40c4-90b3-bd5d2271e6b0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFviRuEz {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFviRuEz" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[07119577-e02b-488d-80c8-89d53e5b1a03]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFviRuEz'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ce46e-994c-43ce-8cc3-6c596fa4ee4a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64fa903-d74a-4975-bd89-d085b3e09dd1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2763c-44a8-4d12-a64d-97971fe0d002]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260]
Nov 29 07:34:29 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b1a3a-6908-4935-936c-2fb91fc80b76]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c982f0-208c-4873-99f2-9e97d6766b7b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:29 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06967415-b28d-46ce-8825-e13ded8b71a8]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFviRuEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing instance network info cache due to event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] Acquiring lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] Acquired lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:34:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updated VIF entry in instance network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.network.neutron [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating instance_info_cache with network_info: [{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d56ef3c9-b7d8-47fd-ad60-6d13cd9dc1a8 req-adac2054-d54c-463c-a0d5-f241d5f4d9c5 service nova] Releasing lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.objects.instance [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:30 user nova-compute[75373]: INFO nova.compute.manager [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Attaching volume ad1e9476-2bbd-4380-a489-fc97ac004725 to /dev/vdb
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.utils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02dfc4-35cb-4b9a-baf9-acf17d811ad4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[680e4540-ba24-4039-80d8-1935d61f0ee3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189fab1-9c63-4953-b2ab-5f66a69a4369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d511ac-d345-45c6-89b4-b46c9ba1db3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23163666362353537', 'path': '/dev/sdg'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163666362353537', 'path': '/dev/sdg'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.objects.instance [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:30 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:34:30 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f28b9f-f86b-41b7-96b5-f3e809de0999]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG os_brick.utils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating existing volume attachment record: 1b6c5101-05c2-4b93-955e-2ff53ad98870 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:34:30 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:30 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:34:30 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:30 user nova-compute[75373]:   <serial>9d09e019-f9e0-4830-8748-14e9af9d7d63</serial>
Nov 29 07:34:30 user nova-compute[75373]: </disk>
Nov 29 07:34:30 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:34:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:13:65:bf, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-240a6d5b-282e-432f-80dc-cc830264229f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.638s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:31 user nova-compute[75373]: INFO nova.compute.manager [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Detaching volume 9d09e019-f9e0-4830-8748-14e9af9d7d63
Nov 29 07:34:32 user nova-compute[75373]: INFO nova.virt.block_device [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Attempting to driver detach volume 9d09e019-f9e0-4830-8748-14e9af9d7d63 from mountpoint /dev/vdb
Nov 29 07:34:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Attempting to detach device vdb from instance 69653ee0-5044-45da-ac6a-407d4cc66740 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:34:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:32 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:34:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:32 user nova-compute[75373]:   <serial>9d09e019-f9e0-4830-8748-14e9af9d7d63</serial>
Nov 29 07:34:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:32 user nova-compute[75373]: </disk>
Nov 29 07:34:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 69653ee0-5044-45da-ac6a-407d4cc66740 from the persistent domain config.
Nov 29 07:34:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69653ee0-5044-45da-ac6a-407d4cc66740 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:34:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:32 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:34:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:32 user nova-compute[75373]:   <serial>9d09e019-f9e0-4830-8748-14e9af9d7d63</serial>
Nov 29 07:34:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:32 user nova-compute[75373]: </disk>
Nov 29 07:34:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:34:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing instance network info cache due to event network-changed-86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:34:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:33 user nova-compute[75373]: DEBUG nova.network.neutron [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Refreshing network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:34:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated VIF entry in instance network info cache for port 86bb9a6e-6e20-4552-8f0f-ca84e2995b21. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:34:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8890674d-28e0-41b0-9024-c8443e283c89 req-7830befa-531e-46b0-b030-5928b25e28de service nova] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-changed-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Refreshing instance network info cache due to event network-changed-2f1e556a-b9d0-480b-9b30-c6335010a583. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:35 user nova-compute[75373]: DEBUG nova.network.neutron [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Refreshing network info cache for port 2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Stashing vm_state: active {{(pid=75373) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:34:36 user nova-compute[75373]: INFO nova.compute.claims [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Claim successful on node user
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.network.neutron [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updated VIF entry in instance network info cache for port 2f1e556a-b9d0-480b-9b30-c6335010a583. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.network.neutron [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-833b3ade-f479-47ab-9ada-938fedaa6b58 req-a72173b2-30ae-44cb-9d30-4e0e6e67d0c8 service nova] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:36 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating resource usage from migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.578s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:36 user nova-compute[75373]: INFO nova.compute.manager [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Migrating
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:36 user nova-compute[75373]: DEBUG nova.network.neutron [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG nova.network.neutron [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Starting migrate_disk_and_power_off {{(pid=75373) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:38 user nova-compute[75373]: WARNING nova.compute.manager [req-7a92a924-3e3d-48b3-b940-c13f87082b94 req-29d52943-f77a-42d5-834c-38083be72c7a service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state active and task_state resize_migrating.
Nov 29 07:34:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance destroyed successfully.
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f1e556a-b9, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4384ded7-2c3f-426d-a47e-cbdb74cde81f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:34:38 user nova-compute[75373]: INFO os_vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9')
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:38 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f06ba7-ac17-456f-b45a-69006a99b66d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:34:38 user nova-compute[75373]: No targets found.
Nov 29 07:34:38 user nova-compute[75373]: iSNS:
Nov 29 07:34:38 user nova-compute[75373]: No targets found.
Nov 29 07:34:38 user nova-compute[75373]: STATIC:
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:34:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:38 user nova-compute[75373]: FIRMWARE:
Nov 29 07:34:38 user nova-compute[75373]: No targets found.
Nov 29 07:34:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:34:38 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:34:38 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[959b6596-2099-4b7f-a3d1-74867c55085e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75db98-76e6-4758-846b-73797d6feb26]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:38 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae02cc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d51a17-a149-45e0-87d5-ae09c1aceaa1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c9d80-7a76-4a67-953c-670a8eafa784]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eeb9de-2237-4720-b819-305cfe712e03]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88a435-af40-4745-a0c7-8fcfdb1cf86a]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138396431373835', '/dev/disk/by-id/scsi-1SCST_BIO2e4f500b-a89d178585b9c530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2e4f500b') {{(pid=86370) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99bb062-3e2d-487a-90de-b19aaf98f8ab]: (4, None) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb873545-b87d-4918-8c98-8de3541afc9b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d69e06e-b515-4988-87dc-35794cd3d134]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]
Nov 29 07:34:38 user nova-compute[75373]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[21584dbd-fc9d-43ea-98e0-546a620b8e7d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== disconnect_volume: return (365ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:34:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iydPSBJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:39 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:39 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:39 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25fc92e-c9c5-42b9-9f76-da64d29357b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:34:39 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb266da-6237-44b1-a9fd-03f233c344b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725] added
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b41c2b1-d8c1-491f-858f-ff4bfb0f1414]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c636e960-f3c5-4d8e-8ec5-43b92ea335b6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iydPSBJr {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iydPSBJr" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9948dc9b-c2ff-4ee2-9891-2b72e430e731]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iydPSBJr'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e11f39-e7db-4fb0-96cd-227fa0fe4294]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e002fd6-9ea0-4f81-88c7-5a55fe98b5fa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b958c74-8272-4a02-a168-e4adb18a9e9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260]
Nov 29 07:34:39 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e676869-3bbd-4b2e-b9b9-65742593f3d5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da3f4b-dd8c-474f-8144-2408d5fd88c6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86a214-9e3a-44c7-8e05-a9f2b6bfd16b]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iydPSBJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Port 2f1e556a-b9d0-480b-9b30-c6335010a583 binding to destination host user is already ACTIVE {{(pid=75373) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:39 user nova-compute[75373]: DEBUG nova.network.neutron [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:40 user nova-compute[75373]: WARNING nova.compute.manager [req-68527971-3a86-4a52-b84f-c06398565106 req-ce0dc694-4c26-4074-b406-9f1a3c8b2dfa service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state active and task_state resize_migrated.
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.utils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee45428-8897-4fb1-ac7c-940f75abf04f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225fc32-0fbd-424e-b956-f4b001dcbebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbe93ab-8195-45b1-b524-68b377eb4c33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f3ec5a-59e3-4a59-8fee-543ee36037f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:34:40 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec13076-4ca3-48c0-92dd-7e35f13772ae]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.utils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26132313636623761', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132313636623761', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:34:40 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:40 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:34:40 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:40 user nova-compute[75373]:   <serial>ad1e9476-2bbd-4380-a489-fc97ac004725</serial>
Nov 29 07:34:40 user nova-compute[75373]: </disk>
Nov 29 07:34:40 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:34:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] No VIF found with MAC fa:16:3e:2d:a2:6e, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-203d49f8-30cd-42d5-a510-2a179ba413a0 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.728s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:34:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:42 user nova-compute[75373]: INFO nova.compute.manager [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Detaching volume 814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab
Nov 29 07:34:42 user nova-compute[75373]: INFO nova.virt.block_device [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Attempting to driver detach volume 814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab from mountpoint /dev/vdb
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Attempting to detach device vdb from instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:42 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:42 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:34:42 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:42 user nova-compute[75373]:   <serial>814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab</serial>
Nov 29 07:34:42 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:42 user nova-compute[75373]: </disk>
Nov 29 07:34:42 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully detached device vdb from instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 from the persistent domain config.
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:42 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:42 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:34:42 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:42 user nova-compute[75373]:   <serial>814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab</serial>
Nov 29 07:34:42 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:42 user nova-compute[75373]: </disk>
Nov 29 07:34:42 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:42 user nova-compute[75373]: INFO nova.compute.manager [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Detaching volume ad1e9476-2bbd-4380-a489-fc97ac004725
Nov 29 07:34:42 user nova-compute[75373]: INFO nova.virt.block_device [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Attempting to driver detach volume ad1e9476-2bbd-4380-a489-fc97ac004725 from mountpoint /dev/vdb
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Attempting to detach device vdb from instance 744afb31-138f-4b63-aacb-729b922548d6 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:34:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:42 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:42 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:34:42 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:42 user nova-compute[75373]:   <serial>ad1e9476-2bbd-4380-a489-fc97ac004725</serial>
Nov 29 07:34:42 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:42 user nova-compute[75373]: </disk>
Nov 29 07:34:42 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully detached device vdb from instance 744afb31-138f-4b63-aacb-729b922548d6 from the persistent domain config.
Nov 29 07:34:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 744afb31-138f-4b63-aacb-729b922548d6 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:34:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:34:43 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:43 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:34:43 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:34:43 user nova-compute[75373]:   <serial>ad1e9476-2bbd-4380-a489-fc97ac004725</serial>
Nov 29 07:34:43 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:34:43 user nova-compute[75373]: </disk>
Nov 29 07:34:43 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:34:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:34:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:45 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:34:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:34:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Starting finish_migration {{(pid=75373) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:34:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Creating image(s)
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Ensure instance console log exists: /opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start _get_guest_xml network_info=[{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b65cbd1b-d24b-4fc1-91e0-57135fbc5aee', 'attached_at': '2023-11-29T07:34:48.000000', 'detached_at': '', 'volume_id': '81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'serial': '81fb0c39-194f-411c-bd10-df1ce47e0dbf'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'b4098359-f785-4e32-972f-0a6c33748411', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:34:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:48 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85758b-2ebe-4439-9539-289dc17e776b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:34:48 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[27798df1-b300-40d7-a3cf-08bf27222b10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf] added
Nov 29 07:34:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d12bf7-28e4-42d6-bc30-57d6da872031]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.189s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb91267-eef4-4951-b225-76190453968e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zunNDFeK {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zunNDFeK" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e32ce1-e4fd-4a83-a4b7-7b4d26f52296]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zunNDFeK'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9fb938-adcb-4f3f-b078-d2b735f76d51]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d594e-6d83-4f68-a538-a01ca2ce9e06]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714d7a7-fe44-421e-97da-a0c407f4ea71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]
Nov 29 07:34:48 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eaaf2a-8d9d-4000-a8e6-17c7a51c4881]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967a1ce-5c27-4ae2-9cf4-12a9826cfa19]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:49 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.522s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51772d55-a20c-4456-9c56-3f162abba07e]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.566s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== connect_volume: return (1570ms) {'type': 'block', 'scsi_wwn': '26138396431373835', 'path': '/dev/sdh'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138396431373835', 'path': '/dev/sdh'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:34:50 user nova-compute[75373]:   <uuid>b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</uuid>
Nov 29 07:34:50 user nova-compute[75373]:   <name>instance-0000001e</name>
Nov 29 07:34:50 user nova-compute[75373]:   <memory>2097152</memory>
Nov 29 07:34:50 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:34:50 user nova-compute[75373]:   <metadata>
Nov 29 07:34:50 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:34:50 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:34:50 user nova-compute[75373]:       <nova:name>tempest-ServerActionsTestOtherA-server-45594249</nova:name>
Nov 29 07:34:50 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:34:48</nova:creationTime>
Nov 29 07:34:50 user nova-compute[75373]:       <nova:flavor name="m1.small">
Nov 29 07:34:50 user nova-compute[75373]:         <nova:memory>2048</nova:memory>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:disk>20</nova:disk>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:34:50 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:34:50 user nova-compute[75373]:       <nova:owner>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:user uuid="fd3d603a0cab4a7da1c743c26b73540d">tempest-ServerActionsTestOtherA-1926007529-project-member</nova:user>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:project uuid="b3f10657321e44f49a30fedbe20dddcf">tempest-ServerActionsTestOtherA-1926007529</nova:project>
Nov 29 07:34:50 user nova-compute[75373]:       </nova:owner>
Nov 29 07:34:50 user nova-compute[75373]:       <nova:ports>
Nov 29 07:34:50 user nova-compute[75373]:         <nova:port uuid="2f1e556a-b9d0-480b-9b30-c6335010a583">
Nov 29 07:34:50 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:34:50 user nova-compute[75373]:         </nova:port>
Nov 29 07:34:50 user nova-compute[75373]:       </nova:ports>
Nov 29 07:34:50 user nova-compute[75373]:     </nova:instance>
Nov 29 07:34:50 user nova-compute[75373]:   </metadata>
Nov 29 07:34:50 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:34:50 user nova-compute[75373]:     <system>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="serial">b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</entry>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="uuid">b65cbd1b-d24b-4fc1-91e0-57135fbc5aee</entry>
Nov 29 07:34:50 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:34:50 user nova-compute[75373]:     </system>
Nov 29 07:34:50 user nova-compute[75373]:   </sysinfo>
Nov 29 07:34:50 user nova-compute[75373]:   <os>
Nov 29 07:34:50 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:34:50 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:34:50 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:34:50 user nova-compute[75373]:   </os>
Nov 29 07:34:50 user nova-compute[75373]:   <features>
Nov 29 07:34:50 user nova-compute[75373]:     <acpi/>
Nov 29 07:34:50 user nova-compute[75373]:     <apic/>
Nov 29 07:34:50 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:34:50 user nova-compute[75373]:   </features>
Nov 29 07:34:50 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:34:50 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:34:50 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:34:50 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:34:50 user nova-compute[75373]:   </clock>
Nov 29 07:34:50 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:34:50 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:34:50 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:34:50 user nova-compute[75373]:   </cpu>
Nov 29 07:34:50 user nova-compute[75373]:   <devices>
Nov 29 07:34:50 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:34:50 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:34:50 user nova-compute[75373]:       <source dev="/dev/sdh"/>
Nov 29 07:34:50 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:34:50 user nova-compute[75373]:       <serial>81fb0c39-194f-411c-bd10-df1ce47e0dbf</serial>
Nov 29 07:34:50 user nova-compute[75373]:     </disk>
Nov 29 07:34:50 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:34:50 user nova-compute[75373]:       <mac address="fa:16:3e:ac:25:31"/>
Nov 29 07:34:50 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:34:50 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:34:50 user nova-compute[75373]:       <target dev="tap2f1e556a-b9"/>
Nov 29 07:34:50 user nova-compute[75373]:     </interface>
Nov 29 07:34:50 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:34:50 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee/console.log" append="off"/>
Nov 29 07:34:50 user nova-compute[75373]:     </serial>
Nov 29 07:34:50 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:34:50 user nova-compute[75373]:     <video>
Nov 29 07:34:50 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:34:50 user nova-compute[75373]:     </video>
Nov 29 07:34:50 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:34:50 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:34:50 user nova-compute[75373]:     </rng>
Nov 29 07:34:50 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:34:50 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:34:50 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:34:50 user nova-compute[75373]:     </memballoon>
Nov 29 07:34:50 user nova-compute[75373]:   </devices>
Nov 29 07:34:50 user nova-compute[75373]: </domain>
Nov 29 07:34:50 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-656402222-network", "vif_mac": "fa:16:3e:ac:25:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG os_vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0490a442-0b7e-58d7-b834-df89ad760f4e', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f1e556a-b9, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f1e556a-b9, col_values=(('qos', UUID('64068f7f-cfd9-43b3-ad5d-d9e91c7bb025')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f1e556a-b9, col_values=(('external_ids', {'iface-id': '2f1e556a-b9d0-480b-9b30-c6335010a583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:25:31', 'vm-uuid': 'b65cbd1b-d24b-4fc1-91e0-57135fbc5aee'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: INFO os_vif [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9')
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] No VIF found with MAC fa:16:3e:ac:25:31, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:34:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:51 user nova-compute[75373]: WARNING nova.compute.manager [req-78b3dffe-9da7-4597-b667-1bbc7ab989d7 req-624cb1ec-78fb-4fd9-9084-384597bd6e3c service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state active and task_state resize_finish.
Nov 29 07:34:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:34:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69653ee0-5044-45da-ac6a-407d4cc66740 is timed out.
Nov 29 07:34:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 69653ee0-5044-45da-ac6a-407d4cc66740 from the live domain config.
Nov 29 07:34:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFviRuEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:34:52 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8bedc4-f2f2-47b5-af8d-e1f51b97e511]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:34:52 user nova-compute[75373]: No targets found.
Nov 29 07:34:52 user nova-compute[75373]: iSNS:
Nov 29 07:34:52 user nova-compute[75373]: No targets found.
Nov 29 07:34:52 user nova-compute[75373]: STATIC:
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:34:52 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:34:52 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:34:52 user nova-compute[75373]: FIRMWARE:
Nov 29 07:34:52 user nova-compute[75373]: No targets found.
Nov 29 07:34:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:34:52 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:34:52 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7c26f-d45a-4251-be02-738d9569debb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[047de024-074c-4101-8035-748949309ae2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:34:52 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:34:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0515ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63'): ({'sdg'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Removing single pathed devices sdg {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b83037-f030-460e-84d6-0940fb89aa1c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436c450-ec22-46eb-ad64-20f9852291d8]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flushing IO for device /dev/sdg {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab2a68-6313-4251-bea7-b359a5d3bdc2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b19a44-fc54-4ad0-ad12-0bce94b1675e]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d78fb4-4409-49e9-8d01-a03088f21a37]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab42281d-7fb7-4f32-bb4b-23abbb325a10]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260]
Nov 29 07:34:52 user nova-compute[75373]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63, portal: 172.16.0.220,3260] successful.
Nov 29 07:34:52 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d09e019-f9e0-4830-8748-14e9af9d7d63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417c985-5da9-4db8-83c0-c78b17b7e390]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== disconnect_volume: return (381ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:34:53 user nova-compute[75373]: WARNING nova.compute.manager [req-b2ff6b53-1ec6-43cf-be13-af2703ffdad0 req-ce99c3af-e286-4e56-960c-a988583133ae service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state active and task_state resize_finish.
Nov 29 07:34:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7006MB free_disk=24.889476776123047GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:34:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance running successfully.
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Failed to set time: agent not configured {{(pid=75373) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-106a1865-d518-4379-b6d4-f4008dd9cada tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] finish_migration finished successfully. {{(pid=75373) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 07:34:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d8086b57-7310-49de-940b-9a1bd0937f6f tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.044s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Applying migration context for instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee as it has an incoming, in-progress migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c. Migration status is finished {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 07:34:54 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating resource usage from migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 69653ee0-5044-45da-ac6a-407d4cc66740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 744afb31-138f-4b63-aacb-729b922548d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4aa9a315-093e-44d7-8574-dcc3230b5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:34:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:34:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:34:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 is timed out.
Nov 29 07:35:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully detached device vdb from instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 from the live domain config.
Nov 29 07:35:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwMlOvnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:35:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2388f3-db1e-4a83-baa7-5eb18e873e91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:35:02 user nova-compute[75373]: No targets found.
Nov 29 07:35:02 user nova-compute[75373]: iSNS:
Nov 29 07:35:02 user nova-compute[75373]: No targets found.
Nov 29 07:35:02 user nova-compute[75373]: STATIC:
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:35:02 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:02 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:02 user nova-compute[75373]: FIRMWARE:
Nov 29 07:35:02 user nova-compute[75373]: No targets found.
Nov 29 07:35:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:35:02 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:35:02 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e8ca2-a374-4a6c-972a-4462b88ff149]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0cca64-7c95-4643-ab74-b44140202bcd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:35:02 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08b239a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab'): ({'sdf'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Removing single pathed devices sdf {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8037d97-f880-461e-8fcb-ebcd67937b9c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f4016f-a60a-42e3-8ab5-3be2131835a8]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flushing IO for device /dev/sdf {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbce5f1-1952-41f2-aac7-2f617c3b3bea]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6646ec56-224a-4f78-ae2f-404376c5cb87]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[345efb9f-e85a-4e5a-b309-2df26859c956]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed131cc-5915-4579-a2be-2fc81495a216]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260]
Nov 29 07:35:03 user nova-compute[75373]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab, portal: 172.16.0.220,3260] successful.
Nov 29 07:35:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21272a3-5768-45df-827a-521557e881a7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== disconnect_volume: return (332ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:35:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 744afb31-138f-4b63-aacb-729b922548d6 is timed out.
Nov 29 07:35:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully detached device vdb from instance 744afb31-138f-4b63-aacb-729b922548d6 from the live domain config.
Nov 29 07:35:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iydPSBJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:35:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfffa0d-87a7-4604-a368-300c9622ceec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:35:03 user nova-compute[75373]: No targets found.
Nov 29 07:35:03 user nova-compute[75373]: iSNS:
Nov 29 07:35:03 user nova-compute[75373]: No targets found.
Nov 29 07:35:03 user nova-compute[75373]: STATIC:
Nov 29 07:35:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:35:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:35:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:35:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725
Nov 29 07:35:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:35:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:03 user nova-compute[75373]: FIRMWARE:
Nov 29 07:35:03 user nova-compute[75373]: No targets found.
Nov 29 07:35:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:35:03 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:35:03 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6fbae-c01e-4500-9617-d5b7e37cc47b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d8901d-e254-47e8-afbc-1bd62b5874e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 (non-flash)
Nov 29 07:35:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08933010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6607d60d-31be-4091-841f-e0fc9fa2d689]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[567eb4f2-b143-464b-bdcd-5af667188e31]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef84b8-d59a-46e1-b682-816817e17aa8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c579a3ad-6b99-4c24-8da3-6f180421a9a4]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[350488f5-9948-404f-843d-c136f33c366e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa15c7-9b69-4b72-8cd1-b663787499f6]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260]
Nov 29 07:35:03 user nova-compute[75373]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725, portal: 172.16.0.220,3260] successful.
Nov 29 07:35:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad1e9476-2bbd-4380-a489-fc97ac004725 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3805e-a03d-48da-bccf-60a25e0c660c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] <== disconnect_volume: return (334ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:35:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d1d16457-573d-4568-ad10-7a38b6f3d9f6 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.661s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:04 user nova-compute[75373]: INFO nova.compute.manager [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Terminating instance
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-unplugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] No waiting events found dispatching network-vif-unplugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-8db4df99-e7df-4b6a-b926-757e4ae9d4ab req-d92ac411-3b9c-46d5-b062-5b862fb481b0 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-unplugged-0b11f649-abec-4189-a9f0-42e0771eead0 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'flavor' on Instance uuid 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b350c4d2-362d-4521-9c38-6129a107481f tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Instance destroyed successfully.
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'resources' on Instance uuid 69e4c87f-c3fa-44df-8abc-acdc84a179c0 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755320239',display_name='tempest-VolumesSnapshotTestJSON-instance-1755320239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755320239',id=27,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQhs+Gc4KAdseLkn6YVG5Hcl2RZn7rDbKSbXtRczuVA3wRHlrqS6vEwOGSB03HaMJ9Mnf4mSBEad3DaSHqlYtqXjFa4njrnAFuWL2CDJELYMZeMJ49s1sf6NOOFhwkNVQ==',key_name='tempest-keypair-2114015273',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-d3yzduwl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=69e4c87f-c3fa-44df-8abc-acdc84a179c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "0b11f649-abec-4189-a9f0-42e0771eead0", "address": "fa:16:3e:82:c8:d1", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b11f649-ab", "ovs_interfaceid": "0b11f649-abec-4189-a9f0-42e0771eead0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_vif [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b11f649-ab, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41e4a5d0-6b3c-4baa-b481-9bc307ad9660) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:04 user nova-compute[75373]: INFO os_vif [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c8:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b11f649-abec-4189-a9f0-42e0771eead0,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b11f649-ab')
Nov 29 07:35:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LwMlOvnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:35:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1db38-fab8-402c-8dce-290e2332f841]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:35:04 user nova-compute[75373]: No targets found.
Nov 29 07:35:04 user nova-compute[75373]: iSNS:
Nov 29 07:35:04 user nova-compute[75373]: No targets found.
Nov 29 07:35:04 user nova-compute[75373]: STATIC:
Nov 29 07:35:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:35:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:35:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:35:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:35:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:04 user nova-compute[75373]: FIRMWARE:
Nov 29 07:35:04 user nova-compute[75373]: No targets found.
Nov 29 07:35:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:35:04 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:35:04 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814d8ea8-e3ad-4c9c-862d-bf3cd49f93ab', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891bc95-f053-4794-b96b-27fce57b0285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[058cf64f-2d69-4387-9d1a-d5b2c32e7f5d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:05 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:05 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:05 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0516440>, {}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Disconnecting from: [] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== disconnect_volume: return (74ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:35:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Deleting instance files /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0_del
Nov 29 07:35:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Deletion of /opt/stack/data/nova/instances/69e4c87f-c3fa-44df-8abc-acdc84a179c0_del complete
Nov 29 07:35:05 user nova-compute[75373]: INFO nova.compute.manager [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 07:35:05 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:35:05 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-36dba0e2-91f9-4860-be34-b907d2095dae req-e4b793a0-355d-461a-a178-d6abdecade12 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-deleted-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:06 user nova-compute[75373]: INFO nova.compute.manager [req-36dba0e2-91f9-4860-be34-b907d2095dae req-e4b793a0-355d-461a-a178-d6abdecade12 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Neutron deleted interface 0b11f649-abec-4189-a9f0-42e0771eead0; detaching it from the instance and deleting it from the info cache
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-36dba0e2-91f9-4860-be34-b907d2095dae req-e4b793a0-355d-461a-a178-d6abdecade12 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:06 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Took 1.11 seconds to deallocate network for instance.
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-36dba0e2-91f9-4860-be34-b907d2095dae req-e4b793a0-355d-461a-a178-d6abdecade12 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Detach interface failed, port_id=0b11f649-abec-4189-a9f0-42e0771eead0, reason: Instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:35:06 user nova-compute[75373]: WARNING nova.volume.cinder [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Attachment 1da9b66c-3180-443e-a46b-c8358e24afd5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1da9b66c-3180-443e-a46b-c8358e24afd5. (HTTP 404) (Request-ID: req-93841123-851b-4ce8-9791-807b3e00276f)
Nov 29 07:35:06 user nova-compute[75373]: INFO nova.compute.manager [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:06 user nova-compute[75373]: INFO nova.compute.manager [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Terminating instance
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] Acquiring lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] No waiting events found dispatching network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:06 user nova-compute[75373]: WARNING nova.compute.manager [req-922e769c-79f5-4e4b-b0cb-77c67edbfa21 req-9560ff1e-e042-4505-aed8-d535160a94d8 service nova] [instance: 69e4c87f-c3fa-44df-8abc-acdc84a179c0] Received unexpected event network-vif-plugged-0b11f649-abec-4189-a9f0-42e0771eead0 for instance with vm_state deleted and task_state None.
Nov 29 07:35:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:06 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Deleted allocations for instance 69e4c87f-c3fa-44df-8abc-acdc84a179c0
Nov 29 07:35:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9b14f40f-9028-4a78-a012-e90c7d6d2c55 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "69e4c87f-c3fa-44df-8abc-acdc84a179c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Instance destroyed successfully.
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'resources' on Instance uuid 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-770343245',display_name='tempest-AttachVolumeTestJSON-server-770343245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-770343245',id=18,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLql80shqLK11A1nX2J4vtTzCSQyTI/nxiQfw/A4sRNX4qZ+eTmxKL/Xcm1XA0EZvEf5gvk1Dug4smL7bamkA93yOJO3dtfQ2r41lng30CddYWi6sXSS4vBWi69s5Sbtcg==',key_name='tempest-keypair-1969282443',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-zwyd0hhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=5bfdfeb1-6da4-4f38-8c3d-ea1af1222680,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "825d3fb3-d49c-4814-82e1-30be81642c31", "address": "fa:16:3e:c9:28:6e", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825d3fb3-d4", "ovs_interfaceid": "825d3fb3-d49c-4814-82e1-30be81642c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG os_vif [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap825d3fb3-d4, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb49485b-123f-431b-a683-0b5928f7d990) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:07 user nova-compute[75373]: INFO os_vif [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:28:6e,bridge_name='br-int',has_traffic_filtering=True,id=825d3fb3-d49c-4814-82e1-30be81642c31,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825d3fb3-d4')
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Deleting instance files /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680_del
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Deletion of /opt/stack/data/nova/instances/5bfdfeb1-6da4-4f38-8c3d-ea1af1222680_del complete
Nov 29 07:35:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.compute.manager [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Detaching volume 04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.compute.manager [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 07:35:07 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.virt.block_device [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Attempting to driver detach volume 04a52303-f96a-4ea1-9566-76f68978ff52 from mountpoint /dev/vdb
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Attempting to detach device vdb from instance 24470f28-4e72-4636-bcca-b0f45051aaeb from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:35:07 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:35:07 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:35:07 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:35:07 user nova-compute[75373]:   <serial>04a52303-f96a-4ea1-9566-76f68978ff52</serial>
Nov 29 07:35:07 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:35:07 user nova-compute[75373]: </disk>
Nov 29 07:35:07 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:35:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully detached device vdb from instance 24470f28-4e72-4636-bcca-b0f45051aaeb from the persistent domain config.
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24470f28-4e72-4636-bcca-b0f45051aaeb from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:35:07 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:35:07 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:35:07 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:35:07 user nova-compute[75373]:   <serial>04a52303-f96a-4ea1-9566-76f68978ff52</serial>
Nov 29 07:35:07 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:35:07 user nova-compute[75373]: </disk>
Nov 29 07:35:07 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:35:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:08 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Took 0.75 seconds to deallocate network for instance.
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing instance network info cache due to event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:08 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Deleted allocations for instance 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-229920f3-8b05-4938-b48a-5af7fdd26a58 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updated VIF entry in instance network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing instance network info cache due to event network-changed-33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquiring lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquired lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Refreshing network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updated VIF entry in instance network info cache for port 33a9f936-8b7c-4c7a-b444-5cf150dc687e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [{"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Releasing lock "refresh_cache-24470f28-4e72-4636-bcca-b0f45051aaeb" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:09 user nova-compute[75373]: WARNING nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-unplugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state deleted and task_state None.
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Acquiring lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] Lock "5bfdfeb1-6da4-4f38-8c3d-ea1af1222680-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] No waiting events found dispatching network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:09 user nova-compute[75373]: WARNING nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received unexpected event network-vif-plugged-825d3fb3-d49c-4814-82e1-30be81642c31 for instance with vm_state deleted and task_state None.
Nov 29 07:35:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-e23a5872-652e-47ea-b864-fcee3028a104 req-1873b97a-be2a-4029-adb5-42df4f2fdf0a service nova] [instance: 5bfdfeb1-6da4-4f38-8c3d-ea1af1222680] Received event network-vif-deleted-825d3fb3-d49c-4814-82e1-30be81642c31 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:35:17 user nova-compute[75373]: INFO nova.compute.manager [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] instance snapshotting
Nov 29 07:35:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing instance network info cache due to event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:17 user nova-compute[75373]: DEBUG nova.network.neutron [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Beginning live snapshot process
Nov 29 07:35:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updated VIF entry in instance network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-423978cc-79bf-4f5d-bd6b-c2922f938367 req-8edd2a63-e7d0-41ce-a328-7c8425fc8119 service nova] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.220s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d.delta 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d.delta 1073741824" returned: 0 in 0.046s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:18 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 07:35:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:35:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:35:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 07:35:19 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:35:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d.delta /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d.delta /opt/stack/data/nova/instances/snapshots/tmpqeusb9xz/b325ab46c4084c9ab6132774584a769d" returned: 0 in 0.342s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Snapshot extracted, beginning image upload
Nov 29 07:35:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:21 user nova-compute[75373]: INFO nova.compute.manager [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Shelving
Nov 29 07:35:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:21 user nova-compute[75373]: DEBUG nova.compute.manager [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:21 user nova-compute[75373]: WARNING nova.compute.manager [req-52ecd971-b70a-47ea-bcda-8db38d53e864 req-33bc07e1-dc44-4585-9c31-523e09a47a4f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state active and task_state shelving.
Nov 29 07:35:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance destroyed successfully.
Nov 29 07:35:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Beginning cold snapshot process
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk /opt/stack/data/nova/instances/snapshots/tmpp3v4xtyb/f04e38d38daf4d87aff2845b5d25a23f {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:22 user nova-compute[75373]: INFO nova.compute.manager [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Terminating instance
Nov 29 07:35:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-unplugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] No waiting events found dispatching network-vif-unplugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-b5ea1372-592d-4b5f-afca-ff765d93ff93 req-2ef920e5-4282-49ea-a9d3-9869d8de7e94 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-unplugged-d863c757-140b-46a8-8366-b155c1a33265 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk /opt/stack/data/nova/instances/snapshots/tmpp3v4xtyb/f04e38d38daf4d87aff2845b5d25a23f" returned: 0 in 0.676s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Snapshot extracted, beginning image upload
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Snapshot image upload complete
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.compute.manager [None req-e722413e-8738-44ea-8e00-ca30f49d934d tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Took 5.37 seconds to snapshot the instance on the hypervisor.
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Instance destroyed successfully.
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'resources' on Instance uuid 69653ee0-5044-45da-ac6a-407d4cc66740 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078329021',display_name='tempest-AttachVolumeNegativeTest-server-2078329021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078329021',id=28,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqtmiUEstR2Sz6TIZ0QeI9MH+YoAxBOBWXb9DpBUkc62pedvU+4eoFzWGItZV4IoQJPolIEl5nFaJZURYAhRBrbHQW8+TQOgpUtAgmRSArJCIxlsZsQuzR2vwzzEztHXw==',key_name='tempest-keypair-929703094',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-nzldu4qd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=69653ee0-5044-45da-ac6a-407d4cc66740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "d863c757-140b-46a8-8366-b155c1a33265", "address": "fa:16:3e:13:65:bf", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd863c757-14", "ovs_interfaceid": "d863c757-140b-46a8-8366-b155c1a33265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG os_vif [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd863c757-14, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ae812df-8109-46f8-bf1b-4302f08ac2db) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:23 user nova-compute[75373]: INFO os_vif [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:65:bf,bridge_name='br-int',has_traffic_filtering=True,id=d863c757-140b-46a8-8366-b155c1a33265,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd863c757-14')
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Deleting instance files /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740_del
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Deletion of /opt/stack/data/nova/instances/69653ee0-5044-45da-ac6a-407d4cc66740_del complete
Nov 29 07:35:23 user nova-compute[75373]: INFO nova.compute.manager [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 29 07:35:23 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:23 user nova-compute[75373]: WARNING nova.compute.manager [req-101df232-6eb7-473a-a5e2-a613ce7304b8 req-01a8d41d-453f-4ffd-9237-214803130148 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 07:35:24 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:24 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Took 0.88 seconds to deallocate network for instance.
Nov 29 07:35:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-02c1c126-1c3e-4e2a-9601-f53edcc3de73 req-bdc28582-9c50-4d43-b595-e06617f279f9 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-deleted-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:24 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:24 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:24 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Deleted allocations for instance 69653ee0-5044-45da-ac6a-407d4cc66740
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb7a9585-6f8a-4c26-88a8-7add7940f6d3 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "69653ee0-5044-45da-ac6a-407d4cc66740" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] Acquiring lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] Lock "69653ee0-5044-45da-ac6a-407d4cc66740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] No waiting events found dispatching network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:25 user nova-compute[75373]: WARNING nova.compute.manager [req-f2263219-657c-43a1-8330-c53c824e57b8 req-6157ec73-6183-417b-a453-badac6198360 service nova] [instance: 69653ee0-5044-45da-ac6a-407d4cc66740] Received unexpected event network-vif-plugged-d863c757-140b-46a8-8366-b155c1a33265 for instance with vm_state deleted and task_state None.
Nov 29 07:35:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Snapshot image upload complete
Nov 29 07:35:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:35:25 user nova-compute[75373]: INFO nova.compute.manager [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Shelve offloading
Nov 29 07:35:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance destroyed successfully.
Nov 29 07:35:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:35:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance destroyed successfully.
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'resources' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZLW/8UHXJjA1ttw+Y8X7Z/m4nn+EiW4I7qaqgAtvuvUTc2reY5VvUEYdvx3LoaaLitBNrr2eCoxiBLerCPFCdeR7MQMq0f01D4FIcD8AzuWNQNas1YNDG1kwGx3n2Qg==',key_name='tempest-keypair-586193429',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:33:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:35:25.671367',shelved_host='user',shelved_image_id='b129cece-c7ce-4290-a94e-dcc4e2e4e4f6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:35:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG os_vif [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d1d3229-da, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2d9b8e0-5a6e-4aa5-9695-10c1c507dc7f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.compute.manager [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing instance network info cache due to event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.network.neutron [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:26 user nova-compute[75373]: INFO os_vif [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da')
Nov 29 07:35:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Deleting instance files /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479_del
Nov 29 07:35:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Deletion of /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479_del complete
Nov 29 07:35:26 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Deleted allocations for instance 4aa9a315-093e-44d7-8574-dcc3230b5479
Nov 29 07:35:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'numa_topology' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:26 user nova-compute[75373]: DEBUG nova.objects.base [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<4aa9a315-093e-44d7-8574-dcc3230b5479> lazy-loaded attributes: resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updated VIF entry in instance network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9d1d3229-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5d002d40-6bb4-4ad8-b6db-04f5d90f812f req-11ca4ec6-b1a6-43cd-be3e-727e54b43e6e service nova] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2a886d2a-8d7f-4520-b7db-ecd328f2f4fc tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.936s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:27 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 24470f28-4e72-4636-bcca-b0f45051aaeb is timed out.
Nov 29 07:35:27 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully detached device vdb from instance 24470f28-4e72-4636-bcca-b0f45051aaeb from the live domain config.
Nov 29 07:35:27 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRHjsYBo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:35:27 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[98017c57-e412-4cc5-9eb5-7e309c7f9ed9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:35:27 user nova-compute[75373]: No targets found.
Nov 29 07:35:27 user nova-compute[75373]: iSNS:
Nov 29 07:35:27 user nova-compute[75373]: No targets found.
Nov 29 07:35:27 user nova-compute[75373]: STATIC:
Nov 29 07:35:27 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:35:27 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:27 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:27 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52
Nov 29 07:35:27 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:27 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:27 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:35:27 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:27 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:27 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:35:27 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:35:27 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:35:27 user nova-compute[75373]: FIRMWARE:
Nov 29 07:35:27 user nova-compute[75373]: No targets found.
Nov 29 07:35:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:35:27 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:35:27 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31934ed-a647-42d1-8fc7-dbce6c4d1b79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c60c92a-9dab-4287-a642-c89180caa241]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:35:27 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:35:27 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae057be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea53ce9e-d0bf-4757-a9b3-f0f7ee499a1b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01adbcd-9b22-4339-9222-2363a2d1b92c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40dfd0-bf03-4b1d-9c5c-989d4969c950]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:35:27 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf585bf1-35b7-4e5b-9ea8-ee28dde56bcb]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a324f7f-0cba-4671-a56f-2fd27d7b5ba5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a9b62a-5bd6-4116-9b56-b8e7c83c6040]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260]
Nov 29 07:35:28 user nova-compute[75373]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52, portal: 172.16.0.220,3260] successful.
Nov 29 07:35:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a52303-f96a-4ea1-9566-76f68978ff52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ffb30-0871-41c8-b55f-df7e6d33cb0f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] <== disconnect_volume: return (290ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'flavor' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0ef9e6a9-8101-4fb5-9901-ecf3032b3173 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing instance network info cache due to event network-changed-3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] Acquiring lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] Acquired lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG nova.network.neutron [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Refreshing network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:33 user nova-compute[75373]: INFO nova.compute.manager [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Terminating instance
Nov 29 07:35:33 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-unplugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] No waiting events found dispatching network-vif-unplugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-549d38ae-5202-4d99-8639-a015fde8ecf1 req-3c75c183-cf35-42c1-a23a-110bc5baf470 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-unplugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updated VIF entry in instance network info cache for port 3e629323-c230-4549-a8f4-c7a0b55c4f78. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating instance_info_cache with network_info: [{"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-564759f7-5303-4ad0-b7cf-4100fefe0e93 req-abbce535-eb01-477c-afad-a31815ad6b72 service nova] Releasing lock "refresh_cache-744afb31-138f-4b63-aacb-729b922548d6" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Instance destroyed successfully.
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'resources' on Instance uuid 744afb31-138f-4b63-aacb-729b922548d6 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1783713197',display_name='tempest-TestStampPattern-server-1783713197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1783713197',id=29,image_ref='6a967996-5aad-4201-b6ec-2d9098446917',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:32:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-6p07rjm6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='ae9d3db8-d3ac-4cfc-81ac-e585aeb53338',image_min_disk='1',image_min_ram='0',image_owner_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',image_owner_project_name='tempest-TestStampPattern-110582567',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-110582567-project-member',image_user_id='09780199e5494517ade9171aeaa5eae3',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:32:46Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=744afb31-138f-4b63-aacb-729b922548d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "address": "fa:16:3e:2d:a2:6e", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e629323-c2", "ovs_interfaceid": "3e629323-c230-4549-a8f4-c7a0b55c4f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG os_vif [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e629323-c2, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57fe4243-b2c9-4f87-aa78-8fafba8f3a9c) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:34 user nova-compute[75373]: INFO os_vif [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:a2:6e,bridge_name='br-int',has_traffic_filtering=True,id=3e629323-c230-4549-a8f4-c7a0b55c4f78,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e629323-c2')
Nov 29 07:35:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Deleting instance files /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6_del
Nov 29 07:35:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Deletion of /opt/stack/data/nova/instances/744afb31-138f-4b63-aacb-729b922548d6_del complete
Nov 29 07:35:34 user nova-compute[75373]: INFO nova.compute.manager [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 29 07:35:34 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:35:34 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:35 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Took 0.62 seconds to deallocate network for instance.
Nov 29 07:35:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-76a12d5a-49b9-452c-bf96-b6d6d49e7746 req-f55fa5e9-8674-48b8-87a8-f79c422af13c service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-deleted-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:35 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Deleted allocations for instance 744afb31-138f-4b63-aacb-729b922548d6
Nov 29 07:35:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e4a992f1-8c1a-4151-a276-ce68fb8eea02 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "744afb31-138f-4b63-aacb-729b922548d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] Acquiring lock "744afb31-138f-4b63-aacb-729b922548d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] Lock "744afb31-138f-4b63-aacb-729b922548d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] No waiting events found dispatching network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:36 user nova-compute[75373]: WARNING nova.compute.manager [req-d7e32fbb-07df-49f1-908c-96d7e0a63f71 req-99bc63e6-4862-449c-a786-c53417c2c283 service nova] [instance: 744afb31-138f-4b63-aacb-729b922548d6] Received unexpected event network-vif-plugged-3e629323-c230-4549-a8f4-c7a0b55c4f78 for instance with vm_state deleted and task_state None.
Nov 29 07:35:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:35:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:35:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [{"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-f44b466e-2b87-414a-a4f7-d951d0a015c3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:35:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:42 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:35:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:35:51 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=24.89413070678711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Applying migration context for instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee as it has an incoming, in-progress migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c. Migration status is finished {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 07:35:51 user nova-compute[75373]: INFO nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating resource usage from migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 24470f28-4e72-4636-bcca-b0f45051aaeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a3110d67-e063-488c-a284-a8beac872c26 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:35:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.477s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:35:52 user nova-compute[75373]: INFO nova.compute.claims [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Claim successful on node user
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:35:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.policy [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39b41ea8ed064f2e80ed67fde84b6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65289e019d8a46efb9f46dd41358ed16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:35:52 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Creating image(s)
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "/opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "/opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk 1073741824" returned: 0 in 0.046s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Successfully created port: 90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Cannot resize image /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Ensure instance console log exists: /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Successfully updated port: 90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquired lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-changed-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Refreshing instance network info cache due to event network-changed-90430c7f-41a9-48c1-9c6d-d09d03eab9ce. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:35:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] Acquiring lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updating instance_info_cache with network_info: [{"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Releasing lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Instance network_info: |[{"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] Acquired lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Refreshing network info cache for port 90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Start _get_guest_xml network_info=[{"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:35:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:35:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1684493719',display_name='tempest-VolumesSnapshotTestJSON-instance-1684493719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1684493719',id=33,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETxfWRHyvR4+74Jx0gE3EHt9tcsniUzAadM7WJ9syQUPHnKk8ZUgAqbJVRtM4sQjs8QCnkaAsSk5VVoRviVAB1sunBX/DHEnZvsZfmqrl1ux7LQMw7wg/8/qf797YkSMA==',key_name='tempest-keypair-1982178400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-fv78si0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=a3110d67-e063-488c-a284-a8beac872c26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'pci_devices' on Instance uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:35:54 user nova-compute[75373]:   <uuid>a3110d67-e063-488c-a284-a8beac872c26</uuid>
Nov 29 07:35:54 user nova-compute[75373]:   <name>instance-00000021</name>
Nov 29 07:35:54 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:35:54 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:35:54 user nova-compute[75373]:   <metadata>
Nov 29 07:35:54 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:35:54 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1684493719</nova:name>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:35:54</nova:creationTime>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:35:54 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:35:54 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:owner>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:user uuid="39b41ea8ed064f2e80ed67fde84b6456">tempest-VolumesSnapshotTestJSON-155394523-project-member</nova:user>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:project uuid="65289e019d8a46efb9f46dd41358ed16">tempest-VolumesSnapshotTestJSON-155394523</nova:project>
Nov 29 07:35:54 user nova-compute[75373]:       </nova:owner>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:35:54 user nova-compute[75373]:       <nova:ports>
Nov 29 07:35:54 user nova-compute[75373]:         <nova:port uuid="90430c7f-41a9-48c1-9c6d-d09d03eab9ce">
Nov 29 07:35:54 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 07:35:54 user nova-compute[75373]:         </nova:port>
Nov 29 07:35:54 user nova-compute[75373]:       </nova:ports>
Nov 29 07:35:54 user nova-compute[75373]:     </nova:instance>
Nov 29 07:35:54 user nova-compute[75373]:   </metadata>
Nov 29 07:35:54 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:35:54 user nova-compute[75373]:     <system>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="serial">a3110d67-e063-488c-a284-a8beac872c26</entry>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="uuid">a3110d67-e063-488c-a284-a8beac872c26</entry>
Nov 29 07:35:54 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:35:54 user nova-compute[75373]:     </system>
Nov 29 07:35:54 user nova-compute[75373]:   </sysinfo>
Nov 29 07:35:54 user nova-compute[75373]:   <os>
Nov 29 07:35:54 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:35:54 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:35:54 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:35:54 user nova-compute[75373]:   </os>
Nov 29 07:35:54 user nova-compute[75373]:   <features>
Nov 29 07:35:54 user nova-compute[75373]:     <acpi/>
Nov 29 07:35:54 user nova-compute[75373]:     <apic/>
Nov 29 07:35:54 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:35:54 user nova-compute[75373]:   </features>
Nov 29 07:35:54 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:35:54 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:35:54 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:35:54 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:35:54 user nova-compute[75373]:   </clock>
Nov 29 07:35:54 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:35:54 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:35:54 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:35:54 user nova-compute[75373]:   </cpu>
Nov 29 07:35:54 user nova-compute[75373]:   <devices>
Nov 29 07:35:54 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:35:54 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:35:54 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk"/>
Nov 29 07:35:54 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:35:54 user nova-compute[75373]:     </disk>
Nov 29 07:35:54 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:35:54 user nova-compute[75373]:       <mac address="fa:16:3e:35:39:72"/>
Nov 29 07:35:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:35:54 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:35:54 user nova-compute[75373]:       <target dev="tap90430c7f-41"/>
Nov 29 07:35:54 user nova-compute[75373]:     </interface>
Nov 29 07:35:54 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:35:54 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/console.log" append="off"/>
Nov 29 07:35:54 user nova-compute[75373]:     </serial>
Nov 29 07:35:54 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:35:54 user nova-compute[75373]:     <video>
Nov 29 07:35:54 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:35:54 user nova-compute[75373]:     </video>
Nov 29 07:35:54 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:35:54 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:35:54 user nova-compute[75373]:     </rng>
Nov 29 07:35:54 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:35:54 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:35:54 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:35:54 user nova-compute[75373]:     </memballoon>
Nov 29 07:35:54 user nova-compute[75373]:   </devices>
Nov 29 07:35:54 user nova-compute[75373]: </domain>
Nov 29 07:35:54 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1684493719',display_name='tempest-VolumesSnapshotTestJSON-instance-1684493719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1684493719',id=33,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETxfWRHyvR4+74Jx0gE3EHt9tcsniUzAadM7WJ9syQUPHnKk8ZUgAqbJVRtM4sQjs8QCnkaAsSk5VVoRviVAB1sunBX/DHEnZvsZfmqrl1ux7LQMw7wg/8/qf797YkSMA==',key_name='tempest-keypair-1982178400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-fv78si0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=a3110d67-e063-488c-a284-a8beac872c26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG os_vif [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e8c5ec3-bec3-593b-b4c5-fbe546944170', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90430c7f-41, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90430c7f-41, col_values=(('qos', UUID('c59cfded-480f-48e6-a9cf-80971d331e7e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90430c7f-41, col_values=(('external_ids', {'iface-id': '90430c7f-41a9-48c1-9c6d-d09d03eab9ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:39:72', 'vm-uuid': 'a3110d67-e063-488c-a284-a8beac872c26'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:54 user nova-compute[75373]: INFO os_vif [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41')
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No VIF found with MAC fa:16:3e:35:39:72, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updated VIF entry in instance network info cache for port 90430c7f-41a9-48c1-9c6d-d09d03eab9ce. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG nova.network.neutron [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updating instance_info_cache with network_info: [{"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e219c5e9-1f42-472a-bb23-0cce811c4bd3 req-b6886f2c-6d27-443a-ab11-073a82be5cb8 service nova] Releasing lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] No waiting events found dispatching network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:55 user nova-compute[75373]: WARNING nova.compute.manager [req-80a71e09-1345-4fe0-9db1-61f4633997db req-34f01d94-b648-48d2-a2c9-b401142f1f54 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received unexpected event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce for instance with vm_state building and task_state spawning.
Nov 29 07:35:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:57 user nova-compute[75373]: INFO nova.compute.manager [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Terminating instance
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:35:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] Instance spawned successfully.
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] No waiting events found dispatching network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:58 user nova-compute[75373]: WARNING nova.compute.manager [req-9f29b668-1de4-489b-a71a-24d58fee7ad8 req-642e37e9-38e6-4d6b-8b27-28221fab443f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received unexpected event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce for instance with vm_state building and task_state spawning.
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.compute.manager [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Took 6.46 seconds to build instance.
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d7a9b860-c5f5-4efd-ace9-343362c14b2a tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.569s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Instance destroyed successfully.
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 24470f28-4e72-4636-bcca-b0f45051aaeb {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-161525513',display_name='tempest-ServerRescueNegativeTestJSON-server-161525513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-161525513',id=25,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY5CnNp5r34Hzz+zYVMb1RWStDYZDnAoGx/DpjoUZVNkg/fAO2qH6a9KOin6R23XcjuI7yxpjf/iAPETktSjg+oc3/7hjmV8jKyiCRaWTE794dLUnl6+mfqHGM3+87KUw==',key_name='tempest-keypair-54276433',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-bpmc1cwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='333925d6528d4e68bd23098c2f3513e5',uuid=24470f28-4e72-4636-bcca-b0f45051aaeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "address": "fa:16:3e:28:cf:ad", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9f936-8b", "ovs_interfaceid": "33a9f936-8b7c-4c7a-b444-5cf150dc687e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG os_vif [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33a9f936-8b, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ca77663-15c8-4fc6-80f3-a08a0e9a138b) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:35:58 user nova-compute[75373]: INFO os_vif [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:cf:ad,bridge_name='br-int',has_traffic_filtering=True,id=33a9f936-8b7c-4c7a-b444-5cf150dc687e,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9f936-8b')
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Deleting instance files /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb_del
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Deletion of /opt/stack/data/nova/instances/24470f28-4e72-4636-bcca-b0f45051aaeb_del complete
Nov 29 07:35:58 user nova-compute[75373]: INFO nova.compute.manager [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:35:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-d1a98221-78b9-46a4-a4c3-f1f72332e489 req-c9271268-4fc5-485b-ad02-535effb0d029 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-unplugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:35:59 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:35:59 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Took 1.04 seconds to deallocate network for instance.
Nov 29 07:35:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:35:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:35:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:35:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:00 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Deleted allocations for instance 24470f28-4e72-4636-bcca-b0f45051aaeb
Nov 29 07:36:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2050218-c0fd-4828-8c40-9e427a211b71 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG nova.compute.manager [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] Acquiring lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] Lock "24470f28-4e72-4636-bcca-b0f45051aaeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG nova.compute.manager [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] No waiting events found dispatching network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:00 user nova-compute[75373]: WARNING nova.compute.manager [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received unexpected event network-vif-plugged-33a9f936-8b7c-4c7a-b444-5cf150dc687e for instance with vm_state deleted and task_state None.
Nov 29 07:36:00 user nova-compute[75373]: DEBUG nova.compute.manager [req-b73ca0f8-c7d7-4176-9533-e8032b4e7a6e req-e9d9b0ec-5b25-49f9-88df-31cb449cc4a2 service nova] [instance: 24470f28-4e72-4636-bcca-b0f45051aaeb] Received event network-vif-deleted-33a9f936-8b7c-4c7a-b444-5cf150dc687e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:36:01 user nova-compute[75373]: INFO nova.compute.claims [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Claim successful on node user
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:36:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:36:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Creating image(s)
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "/opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "/opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:01 user nova-compute[75373]: DEBUG nova.policy [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f571f40d066b4d198fcf6d49c22ad1c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249771bcbe724be3ac7c15231dd07e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk 1073741824" returned: 0 in 0.051s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Successfully created port: cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Cannot resize image /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Ensure instance console log exists: /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Successfully updated port: cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquired lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-changed-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Refreshing instance network info cache due to event network-changed-cded9c97-d5f1-449d-ad58-3c8c96040384. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] Acquiring lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating instance_info_cache with network_info: [{"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Releasing lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Instance network_info: |[{"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] Acquired lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Refreshing network info cache for port cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Start _get_guest_xml network_info=[{"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:36:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492767153',display_name='tempest-AttachVolumeTestJSON-server-492767153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492767153',id=34,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdIqg4ojCpm4KdzunfdKo/5yNRQ9a/vBqyI9dB9/r5U/16FADRCxKmeYCDysVwcQJHZUhUO9gtUflQk4BiBi0zBdcVVcklYlroRoFtWd/9NHN2fL4KBnNiTtHrC5BuD6Q==',key_name='tempest-keypair-1089222370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-7d86do01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=0d39f8bb-1f10-4e7b-bb5e-8207376b9747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:36:03 user nova-compute[75373]:   <uuid>0d39f8bb-1f10-4e7b-bb5e-8207376b9747</uuid>
Nov 29 07:36:03 user nova-compute[75373]:   <name>instance-00000022</name>
Nov 29 07:36:03 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:36:03 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:36:03 user nova-compute[75373]:   <metadata>
Nov 29 07:36:03 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:36:03 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeTestJSON-server-492767153</nova:name>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:36:03</nova:creationTime>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:36:03 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:36:03 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:owner>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:user uuid="f571f40d066b4d198fcf6d49c22ad1c1">tempest-AttachVolumeTestJSON-1182766882-project-member</nova:user>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:project uuid="249771bcbe724be3ac7c15231dd07e45">tempest-AttachVolumeTestJSON-1182766882</nova:project>
Nov 29 07:36:03 user nova-compute[75373]:       </nova:owner>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:36:03 user nova-compute[75373]:       <nova:ports>
Nov 29 07:36:03 user nova-compute[75373]:         <nova:port uuid="cded9c97-d5f1-449d-ad58-3c8c96040384">
Nov 29 07:36:03 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:36:03 user nova-compute[75373]:         </nova:port>
Nov 29 07:36:03 user nova-compute[75373]:       </nova:ports>
Nov 29 07:36:03 user nova-compute[75373]:     </nova:instance>
Nov 29 07:36:03 user nova-compute[75373]:   </metadata>
Nov 29 07:36:03 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:36:03 user nova-compute[75373]:     <system>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="serial">0d39f8bb-1f10-4e7b-bb5e-8207376b9747</entry>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="uuid">0d39f8bb-1f10-4e7b-bb5e-8207376b9747</entry>
Nov 29 07:36:03 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:36:03 user nova-compute[75373]:     </system>
Nov 29 07:36:03 user nova-compute[75373]:   </sysinfo>
Nov 29 07:36:03 user nova-compute[75373]:   <os>
Nov 29 07:36:03 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:36:03 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:36:03 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:36:03 user nova-compute[75373]:   </os>
Nov 29 07:36:03 user nova-compute[75373]:   <features>
Nov 29 07:36:03 user nova-compute[75373]:     <acpi/>
Nov 29 07:36:03 user nova-compute[75373]:     <apic/>
Nov 29 07:36:03 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:36:03 user nova-compute[75373]:   </features>
Nov 29 07:36:03 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:36:03 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:36:03 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:36:03 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:36:03 user nova-compute[75373]:   </clock>
Nov 29 07:36:03 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:36:03 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:36:03 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:36:03 user nova-compute[75373]:   </cpu>
Nov 29 07:36:03 user nova-compute[75373]:   <devices>
Nov 29 07:36:03 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:36:03 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:36:03 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk"/>
Nov 29 07:36:03 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:36:03 user nova-compute[75373]:     </disk>
Nov 29 07:36:03 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:36:03 user nova-compute[75373]:       <mac address="fa:16:3e:de:a0:b1"/>
Nov 29 07:36:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:03 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:36:03 user nova-compute[75373]:       <target dev="tapcded9c97-d5"/>
Nov 29 07:36:03 user nova-compute[75373]:     </interface>
Nov 29 07:36:03 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:36:03 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/console.log" append="off"/>
Nov 29 07:36:03 user nova-compute[75373]:     </serial>
Nov 29 07:36:03 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:36:03 user nova-compute[75373]:     <video>
Nov 29 07:36:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:03 user nova-compute[75373]:     </video>
Nov 29 07:36:03 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:36:03 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:36:03 user nova-compute[75373]:     </rng>
Nov 29 07:36:03 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:36:03 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:36:03 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:36:03 user nova-compute[75373]:     </memballoon>
Nov 29 07:36:03 user nova-compute[75373]:   </devices>
Nov 29 07:36:03 user nova-compute[75373]: </domain>
Nov 29 07:36:03 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492767153',display_name='tempest-AttachVolumeTestJSON-server-492767153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492767153',id=34,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdIqg4ojCpm4KdzunfdKo/5yNRQ9a/vBqyI9dB9/r5U/16FADRCxKmeYCDysVwcQJHZUhUO9gtUflQk4BiBi0zBdcVVcklYlroRoFtWd/9NHN2fL4KBnNiTtHrC5BuD6Q==',key_name='tempest-keypair-1089222370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-7d86do01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=0d39f8bb-1f10-4e7b-bb5e-8207376b9747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG os_vif [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac0df693-abb6-5d92-9e0c-2bfd58d8dbc7', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcded9c97-d5, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcded9c97-d5, col_values=(('qos', UUID('26339768-5461-41c8-a84b-1ee0d0c8b44e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcded9c97-d5, col_values=(('external_ids', {'iface-id': 'cded9c97-d5f1-449d-ad58-3c8c96040384', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a0:b1', 'vm-uuid': '0d39f8bb-1f10-4e7b-bb5e-8207376b9747'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:03 user nova-compute[75373]: INFO os_vif [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5')
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No VIF found with MAC fa:16:3e:de:a0:b1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updated VIF entry in instance network info cache for port cded9c97-d5f1-449d-ad58-3c8c96040384. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating instance_info_cache with network_info: [{"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-59e9c6a4-ab4e-4c61-b0c5-3cb0891781db req-93111bb1-f787-4582-ada7-280e5a9a2926 service nova] Releasing lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] No waiting events found dispatching network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:05 user nova-compute[75373]: WARNING nova.compute.manager [req-04f122cb-19d9-4bdd-9256-bca56c3851c9 req-2dce1b98-361a-4f37-9430-58b98b340972 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received unexpected event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 for instance with vm_state building and task_state spawning.
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:36:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Instance spawned successfully.
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] No waiting events found dispatching network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:07 user nova-compute[75373]: WARNING nova.compute.manager [req-f85844ac-4b4f-4c19-a1d4-4997d91909b8 req-e99f82f4-2711-4cfb-85fc-daaecd6c34d6 service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received unexpected event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 for instance with vm_state building and task_state spawning.
Nov 29 07:36:07 user nova-compute[75373]: INFO nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 29 07:36:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:36:07 user nova-compute[75373]: INFO nova.compute.manager [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Took 6.23 seconds to build instance.
Nov 29 07:36:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fa4cec79-637d-48e3-a03c-59ba729fd117 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.326s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:15 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:36:15 user nova-compute[75373]: INFO nova.compute.claims [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Claim successful on node user
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:36:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.policy [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fa1e258308644589a58d3ba9b99d09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32b5fe43b84c2b9df54631c7a3edb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:36:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Creating image(s)
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "/opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk 1073741824" returned: 0 in 0.055s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Successfully created port: 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Cannot resize image /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Ensure instance console log exists: /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Successfully updated port: 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquired lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-changed-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Refreshing instance network info cache due to event network-changed-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] Acquiring lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updating instance_info_cache with network_info: [{"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Releasing lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Instance network_info: |[{"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] Acquired lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Refreshing network info cache for port 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Start _get_guest_xml network_info=[{"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:36:18 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:18 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188350420',display_name='tempest-AttachVolumeNegativeTest-server-188350420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188350420',id=35,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaXBsz5yOlnRKwJg7MXHN33z4nhqnZVUrpxoifnlYpQPOw8dEgStjbq8BH6k/gHwE+hMkff1yv4pFX1KvIqkX/CYz88eTe48EtNq6kvn9lTTBtH4nQoKrYAXBBhgsWlw==',key_name='tempest-keypair-981803260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-rb24kiqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=1f34909f-b01d-49e9-af42-194e75572607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:36:18 user nova-compute[75373]:   <uuid>1f34909f-b01d-49e9-af42-194e75572607</uuid>
Nov 29 07:36:18 user nova-compute[75373]:   <name>instance-00000023</name>
Nov 29 07:36:18 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:36:18 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:36:18 user nova-compute[75373]:   <metadata>
Nov 29 07:36:18 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:36:18 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeNegativeTest-server-188350420</nova:name>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:36:18</nova:creationTime>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:36:18 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:36:18 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:owner>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:user uuid="0fa1e258308644589a58d3ba9b99d09a">tempest-AttachVolumeNegativeTest-2030774109-project-member</nova:user>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:project uuid="fc32b5fe43b84c2b9df54631c7a3edb9">tempest-AttachVolumeNegativeTest-2030774109</nova:project>
Nov 29 07:36:18 user nova-compute[75373]:       </nova:owner>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:36:18 user nova-compute[75373]:       <nova:ports>
Nov 29 07:36:18 user nova-compute[75373]:         <nova:port uuid="9fccea0d-42d5-4f4e-83ae-a2ac0b51d134">
Nov 29 07:36:18 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:36:18 user nova-compute[75373]:         </nova:port>
Nov 29 07:36:18 user nova-compute[75373]:       </nova:ports>
Nov 29 07:36:18 user nova-compute[75373]:     </nova:instance>
Nov 29 07:36:18 user nova-compute[75373]:   </metadata>
Nov 29 07:36:18 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:36:18 user nova-compute[75373]:     <system>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="serial">1f34909f-b01d-49e9-af42-194e75572607</entry>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="uuid">1f34909f-b01d-49e9-af42-194e75572607</entry>
Nov 29 07:36:18 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:36:18 user nova-compute[75373]:     </system>
Nov 29 07:36:18 user nova-compute[75373]:   </sysinfo>
Nov 29 07:36:18 user nova-compute[75373]:   <os>
Nov 29 07:36:18 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:36:18 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:36:18 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:36:18 user nova-compute[75373]:   </os>
Nov 29 07:36:18 user nova-compute[75373]:   <features>
Nov 29 07:36:18 user nova-compute[75373]:     <acpi/>
Nov 29 07:36:18 user nova-compute[75373]:     <apic/>
Nov 29 07:36:18 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:36:18 user nova-compute[75373]:   </features>
Nov 29 07:36:18 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:36:18 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:36:18 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:36:18 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:36:18 user nova-compute[75373]:   </clock>
Nov 29 07:36:18 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:36:18 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:36:18 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:36:18 user nova-compute[75373]:   </cpu>
Nov 29 07:36:18 user nova-compute[75373]:   <devices>
Nov 29 07:36:18 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:36:18 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:36:18 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk"/>
Nov 29 07:36:18 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:36:18 user nova-compute[75373]:     </disk>
Nov 29 07:36:18 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:36:18 user nova-compute[75373]:       <mac address="fa:16:3e:3c:5a:a1"/>
Nov 29 07:36:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:18 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:36:18 user nova-compute[75373]:       <target dev="tap9fccea0d-42"/>
Nov 29 07:36:18 user nova-compute[75373]:     </interface>
Nov 29 07:36:18 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:36:18 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/console.log" append="off"/>
Nov 29 07:36:18 user nova-compute[75373]:     </serial>
Nov 29 07:36:18 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:36:18 user nova-compute[75373]:     <video>
Nov 29 07:36:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:18 user nova-compute[75373]:     </video>
Nov 29 07:36:18 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:36:18 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:36:18 user nova-compute[75373]:     </rng>
Nov 29 07:36:18 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:36:18 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:36:18 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:36:18 user nova-compute[75373]:     </memballoon>
Nov 29 07:36:18 user nova-compute[75373]:   </devices>
Nov 29 07:36:18 user nova-compute[75373]: </domain>
Nov 29 07:36:18 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188350420',display_name='tempest-AttachVolumeNegativeTest-server-188350420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188350420',id=35,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaXBsz5yOlnRKwJg7MXHN33z4nhqnZVUrpxoifnlYpQPOw8dEgStjbq8BH6k/gHwE+hMkff1yv4pFX1KvIqkX/CYz88eTe48EtNq6kvn9lTTBtH4nQoKrYAXBBhgsWlw==',key_name='tempest-keypair-981803260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-rb24kiqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=1f34909f-b01d-49e9-af42-194e75572607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG os_vif [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9b896a4-d8df-54f9-9c57-38cfeeeaa1f2', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fccea0d-42, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fccea0d-42, col_values=(('qos', UUID('9b71363a-7d4f-4ecb-8b27-64b6812b835e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fccea0d-42, col_values=(('external_ids', {'iface-id': '9fccea0d-42d5-4f4e-83ae-a2ac0b51d134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:5a:a1', 'vm-uuid': '1f34909f-b01d-49e9-af42-194e75572607'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:18 user nova-compute[75373]: INFO os_vif [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42')
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:3c:5a:a1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updated VIF entry in instance network info cache for port 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updating instance_info_cache with network_info: [{"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55c89af9-3a6c-4aa8-a58f-05c0919c53dc req-1dd877af-c52a-42aa-a431-5281cfb82e72 service nova] Releasing lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] No waiting events found dispatching network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:20 user nova-compute[75373]: WARNING nova.compute.manager [req-0a8fc568-3e93-4a7f-a7a2-2cd77d0ebcfe req-82db4924-1e15-4dad-aa68-6e18483cb48d service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received unexpected event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 for instance with vm_state building and task_state spawning.
Nov 29 07:36:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:36:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Instance spawned successfully.
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:22 user nova-compute[75373]: INFO nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:36:22 user nova-compute[75373]: INFO nova.compute.manager [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Took 6.48 seconds to build instance.
Nov 29 07:36:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fe8e6d47-f803-4490-bfd8-20ed1b96eb87 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.590s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] No waiting events found dispatching network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:22 user nova-compute[75373]: WARNING nova.compute.manager [req-61b3f810-f4df-4f52-b6d9-331cd83e8a52 req-c879a97b-c019-407a-a784-a763df4342bb service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received unexpected event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 for instance with vm_state active and task_state None.
Nov 29 07:36:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Going to confirm migration 2 {{(pid=75373) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:36:25 user nova-compute[75373]: INFO nova.compute.claims [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Claim successful on node user
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquired lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'info_cache' on Instance uuid b65cbd1b-d24b-4fc1-91e0-57135fbc5aee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:36:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:36:26 user nova-compute[75373]: INFO nova.virt.block_device [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Booting with volume-backed-image f913c500-a725-42d4-bfc8-b62422a3c4fa at /dev/vda
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.policy [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7dec6d7789c4430ad19e175de4b3519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff517549ee99421aa0e9d570d4fb6941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [{"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Releasing lock "refresh_cache-b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'migration_context' on Instance uuid b65cbd1b-d24b-4fc1-91e0-57135fbc5aee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG nova.objects.base [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Object Instance<b65cbd1b-d24b-4fc1-91e0-57135fbc5aee> lazy-loaded attributes: info_cache,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:27 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:27 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:27 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Successfully created port: 673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:36:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.556s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:27 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Deleted allocation for migration 09b4d19f-bf81-4356-84fb-eb4cbb52172c
Nov 29 07:36:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3a7ccd1e-90cb-4db7-b3cf-41f5618092ab tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.049s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Successfully updated port: 673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-changed-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Refreshing instance network info cache due to event network-changed-673cb70d-ed66-49b5-8d03-074b629d1f33. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] Acquiring lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance network_info: |[{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] Acquired lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:28 user nova-compute[75373]: DEBUG nova.network.neutron [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Refreshing network info cache for port 673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:36:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updated VIF entry in instance network info cache for port 673cb70d-ed66-49b5-8d03-074b629d1f33. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:36:29 user nova-compute[75373]: DEBUG nova.network.neutron [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f413500c-183a-4d06-ad80-f5d26efff951 req-8d3cd878-4dff-4712-a481-da8fee95f3bc service nova] Releasing lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[37692a94-0e02-45df-8f1f-436a14b606d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc647af-1d8b-4d69-85cc-516abc5ee236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9ea939-5326-492f-a68e-5727f2bff02a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8b7a6-6e9c-447d-85a9-0f3dfa7434e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:36:32 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:36:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda7e2e-6b46-4c74-9ad0-3bbdd07c645a]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:36:32 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating existing volume attachment record: cad0a50a-f005-459a-b8bc-45fa957dcf1a {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:36:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing instance network info cache due to event network-changed-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] Acquiring lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] Acquired lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.network.neutron [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Refreshing network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:37 user nova-compute[75373]: INFO nova.compute.manager [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Terminating instance
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.network.neutron [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updated VIF entry in instance network info cache for port f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.network.neutron [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [{"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-304b5d4a-ce36-4ffc-8733-571cb466f53e req-7de91922-d172-40ea-9350-6af4ebb9bcc8 service nova] Releasing lock "refresh_cache-ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-unplugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] No waiting events found dispatching network-vif-unplugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-6576c33a-16d8-4516-af85-36cbb33d15c1 req-202954ed-a250-4bdb-921a-fc9d96094837 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-unplugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:36:37 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Instance destroyed successfully.
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.objects.instance [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lazy-loading 'resources' on Instance uuid ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1546011437',display_name='tempest-TestStampPattern-server-1546011437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1546011437',id=26,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNlXD61gbCauoSqc3OnvRNRKdbcMIw5dflepjC7MjQof/R4NgrSKsqD6LVz1rtcxpRqMmvDlf3GARpc634SFBDokN4jW/NjU+dMZNiiv8ruvPhLXFxxNWDm9lsrzgoKzA==',key_name='tempest-TestStampPattern-992084968',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:29:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fc5739c33ed4c0ab7cd0f16a62eb0af',ramdisk_id='',reservation_id='r-scmgrcln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-110582567',owner_user_name='tempest-TestStampPattern-110582567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:32:34Z,user_data=None,user_id='09780199e5494517ade9171aeaa5eae3',uuid=ae9d3db8-d3ac-4cfc-81ac-e585aeb53338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converting VIF {"id": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "address": "fa:16:3e:c6:97:c3", "network": {"id": "6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3", "bridge": "br-int", "label": "tempest-TestStampPattern-341263819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fc5739c33ed4c0ab7cd0f16a62eb0af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91b4d14-39", "ovs_interfaceid": "f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG os_vif [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91b4d14-39, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15838288-17dc-4b09-a95f-ef396242c62d) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:37 user nova-compute[75373]: INFO os_vif [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a,network=Network(6c2bb4ea-0c32-4eb9-b2b4-8b26fb89dbe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91b4d14-39')
Nov 29 07:36:37 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Deleting instance files /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338_del
Nov 29 07:36:37 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Deletion of /opt/stack/data/nova/instances/ae9d3db8-d3ac-4cfc-81ac-e585aeb53338_del complete
Nov 29 07:36:38 user nova-compute[75373]: INFO nova.compute.manager [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 07:36:38 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:38 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Took 0.44 seconds to deallocate network for instance.
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c0d0dd1-5139-47bb-9edc-93af16a2d3a7 req-a6a245d7-7d05-4d38-8f78-8a286e659f4b service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-deleted-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:38 user nova-compute[75373]: INFO nova.compute.manager [req-8c0d0dd1-5139-47bb-9edc-93af16a2d3a7 req-a6a245d7-7d05-4d38-8f78-8a286e659f4b service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Neutron deleted interface f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a; detaching it from the instance and deleting it from the info cache
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-8c0d0dd1-5139-47bb-9edc-93af16a2d3a7 req-a6a245d7-7d05-4d38-8f78-8a286e659f4b service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c0d0dd1-5139-47bb-9edc-93af16a2d3a7 req-a6a245d7-7d05-4d38-8f78-8a286e659f4b service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Detach interface failed, port_id=f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a, reason: Instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:38 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Deleted allocations for instance ae9d3db8-d3ac-4cfc-81ac-e585aeb53338
Nov 29 07:36:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42c7d99d-4783-41ff-9ccc-bf391d70c6d3 tempest-TestStampPattern-110582567 tempest-TestStampPattern-110582567-project-member] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] Acquiring lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] Lock "ae9d3db8-d3ac-4cfc-81ac-e585aeb53338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] No waiting events found dispatching network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:39 user nova-compute[75373]: WARNING nova.compute.manager [req-cf17f1f7-4d35-434a-ae4e-b2e4c9dc4875 req-af811c23-ef8b-45f4-ad94-7c524f948d71 service nova] [instance: ae9d3db8-d3ac-4cfc-81ac-e585aeb53338] Received unexpected event network-vif-plugged-f91b4d14-3955-4ce0-a5e9-c3c6b84ef74a for instance with vm_state deleted and task_state None.
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:36:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Creating image(s)
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Ensure instance console log exists: /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start _get_guest_xml network_info=[{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f711ec64-cda6-4ee9-bc54-32b2b34d2acd', 'attached_at': '', 'detached_at': '', 'volume_id': '361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'serial': '361fe1f7-43f4-4a8d-8b31-bf1e01413d83'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cad0a50a-f005-459a-b8bc-45fa957dcf1a', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:40 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:40 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:36:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:36:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:36:40 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:36:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7eb32-eff0-4a50-9945-d314896fc3dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:36:40 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25dfa3c-7e59-459d-8aa1-96c03ef5590f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83] added
Nov 29 07:36:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d1147-6fa1-457c-95f0-0652b6f4ebdd]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b9d7a-113c-4d0d-8800-ac86fb138b69]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmYCvwjE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmYCvwjE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f6f64-7bb3-499b-a750-48b5f72774a0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BmYCvwjE'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad9a2dc-bdb7-4def-973b-753ee12eaf42]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d8f41-9fb4-48b9-a3c2-377e4ed898e4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f91b16-1113-4901-9e96-669ee5c5b238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260]
Nov 29 07:36:41 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260] successful.
Nov 29 07:36:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4147b0-cec0-4ece-997a-d44ebe0e727d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[489be973-eb43-46af-945a-ae793230b698]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:41 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:36:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c01f17-1dd3-40ad-96a5-10335a110bcd]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [{"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-844be7c0-d83d-401f-9c62-bca197bf1683" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:36:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23433666639356363', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433666639356363', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1365733974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1365733974',id=36,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-q2ydo015',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:27Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=f711ec64-cda6-4ee9-bc54-32b2b34d2acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:36:42 user nova-compute[75373]:   <uuid>f711ec64-cda6-4ee9-bc54-32b2b34d2acd</uuid>
Nov 29 07:36:42 user nova-compute[75373]:   <name>instance-00000024</name>
Nov 29 07:36:42 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:36:42 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:36:42 user nova-compute[75373]:   <metadata>
Nov 29 07:36:42 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:36:42 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1365733974</nova:name>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:36:40</nova:creationTime>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:36:42 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:36:42 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:owner>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:36:42 user nova-compute[75373]:       </nova:owner>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:36:42 user nova-compute[75373]:       <nova:ports>
Nov 29 07:36:42 user nova-compute[75373]:         <nova:port uuid="673cb70d-ed66-49b5-8d03-074b629d1f33">
Nov 29 07:36:42 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:36:42 user nova-compute[75373]:         </nova:port>
Nov 29 07:36:42 user nova-compute[75373]:       </nova:ports>
Nov 29 07:36:42 user nova-compute[75373]:     </nova:instance>
Nov 29 07:36:42 user nova-compute[75373]:   </metadata>
Nov 29 07:36:42 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:36:42 user nova-compute[75373]:     <system>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="serial">f711ec64-cda6-4ee9-bc54-32b2b34d2acd</entry>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="uuid">f711ec64-cda6-4ee9-bc54-32b2b34d2acd</entry>
Nov 29 07:36:42 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:36:42 user nova-compute[75373]:     </system>
Nov 29 07:36:42 user nova-compute[75373]:   </sysinfo>
Nov 29 07:36:42 user nova-compute[75373]:   <os>
Nov 29 07:36:42 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:36:42 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:36:42 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:36:42 user nova-compute[75373]:   </os>
Nov 29 07:36:42 user nova-compute[75373]:   <features>
Nov 29 07:36:42 user nova-compute[75373]:     <acpi/>
Nov 29 07:36:42 user nova-compute[75373]:     <apic/>
Nov 29 07:36:42 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:36:42 user nova-compute[75373]:   </features>
Nov 29 07:36:42 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:36:42 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:36:42 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:36:42 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:36:42 user nova-compute[75373]:   </clock>
Nov 29 07:36:42 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:36:42 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:36:42 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:36:42 user nova-compute[75373]:   </cpu>
Nov 29 07:36:42 user nova-compute[75373]:   <devices>
Nov 29 07:36:42 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:36:42 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:36:42 user nova-compute[75373]:       <source dev="/dev/sdc"/>
Nov 29 07:36:42 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:36:42 user nova-compute[75373]:       <serial>361fe1f7-43f4-4a8d-8b31-bf1e01413d83</serial>
Nov 29 07:36:42 user nova-compute[75373]:     </disk>
Nov 29 07:36:42 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:36:42 user nova-compute[75373]:       <mac address="fa:16:3e:f6:66:15"/>
Nov 29 07:36:42 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:42 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:36:42 user nova-compute[75373]:       <target dev="tap673cb70d-ed"/>
Nov 29 07:36:42 user nova-compute[75373]:     </interface>
Nov 29 07:36:42 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:36:42 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/console.log" append="off"/>
Nov 29 07:36:42 user nova-compute[75373]:     </serial>
Nov 29 07:36:42 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:36:42 user nova-compute[75373]:     <video>
Nov 29 07:36:42 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:36:42 user nova-compute[75373]:     </video>
Nov 29 07:36:42 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:36:42 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:36:42 user nova-compute[75373]:     </rng>
Nov 29 07:36:42 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:36:42 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:36:42 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:36:42 user nova-compute[75373]:     </memballoon>
Nov 29 07:36:42 user nova-compute[75373]:   </devices>
Nov 29 07:36:42 user nova-compute[75373]: </domain>
Nov 29 07:36:42 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1365733974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1365733974',id=36,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-q2ydo015',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:27Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=f711ec64-cda6-4ee9-bc54-32b2b34d2acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG os_vif [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a857193-9650-5527-a5fc-1e3094e063a6', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap673cb70d-ed, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap673cb70d-ed, col_values=(('qos', UUID('0ae2cbbc-7e33-4faa-9cdd-e457859eeb94')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap673cb70d-ed, col_values=(('external_ids', {'iface-id': '673cb70d-ed66-49b5-8d03-074b629d1f33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:66:15', 'vm-uuid': 'f711ec64-cda6-4ee9-bc54-32b2b34d2acd'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:42 user nova-compute[75373]: INFO os_vif [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed')
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:36:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:f6:66:15, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:43 user nova-compute[75373]: WARNING nova.compute.manager [req-eaa669af-bdbd-4c85-bb4a-c9849bef0419 req-e027fb8d-2883-4920-91d8-b2386b3c44ad service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state building and task_state spawning.
Nov 29 07:36:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:36:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance spawned successfully.
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:36:45 user nova-compute[75373]: INFO nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:45 user nova-compute[75373]: WARNING nova.compute.manager [req-42c20dcf-bb40-4d0c-8d2a-c00d85ca5465 req-aa12e1a0-50e3-4d3f-b330-d5b2ceaf4e86 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state active and task_state None.
Nov 29 07:36:45 user nova-compute[75373]: INFO nova.compute.manager [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Took 19.92 seconds to build instance.
Nov 29 07:36:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a78206aa-0490-457e-aa10-c04dae30984e tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.029s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:36:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:48 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:36:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk.rescue --force-share --output=json" returned: 0 in 0.352s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:36:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:52 user nova-compute[75373]: INFO nova.compute.manager [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Terminating instance
Nov 29 07:36:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-65ee1426-0f47-4468-a5d8-df936e8d12ef req-eb9ade1a-fb45-4bf2-8337-bd011d86e88a service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-unplugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Instance destroyed successfully.
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lazy-loading 'resources' on Instance uuid f44b466e-2b87-414a-a4f7-d951d0a015c3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2127939767',display_name='tempest-ServerActionsTestOtherB-server-2127939767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2127939767',id=24,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDxlpN0Mkryh0qSha4M1d0Vi1XNx9dUVVDaZVmlB9OGuAPoXJcjVN9eSfdp1BV3JqebQ1KtMsQ7f02pIlsu4bkMFaik/h7xQ20+LgNQA5rckMXBKOiFmGeaADPvciugjw==',key_name='tempest-keypair-184935545',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:34:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e613704433449d9a6db31215d1b6867',ramdisk_id='',reservation_id='r-5bsde9wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1291056582',owner_user_name='tempest-ServerActionsTestOtherB-1291056582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:34:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c03943036e49e3b5021c5784e42ed0',uuid=f44b466e-2b87-414a-a4f7-d951d0a015c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converting VIF {"id": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "address": "fa:16:3e:8f:df:fb", "network": {"id": "67f73e5d-50a9-486c-ad73-62c7c48795ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1171201028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e613704433449d9a6db31215d1b6867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb76a9-e3", "ovs_interfaceid": "68cb76a9-e30c-4470-97d6-9e028490a7fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_vif [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68cb76a9-e3, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=306dad30-f07d-4ea6-ad6a-2b6c30bbadc9) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:53 user nova-compute[75373]: INFO os_vif [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:df:fb,bridge_name='br-int',has_traffic_filtering=True,id=68cb76a9-e30c-4470-97d6-9e028490a7fe,network=Network(67f73e5d-50a9-486c-ad73-62c7c48795ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb76a9-e3')
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWAwTYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:36:53 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe32e13-dd7a-4a42-82cb-1b606be8952f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:36:53 user nova-compute[75373]: No targets found.
Nov 29 07:36:53 user nova-compute[75373]: iSNS:
Nov 29 07:36:53 user nova-compute[75373]: No targets found.
Nov 29 07:36:53 user nova-compute[75373]: STATIC:
Nov 29 07:36:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef
Nov 29 07:36:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:36:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:36:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:36:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:36:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:36:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:36:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:36:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:36:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:36:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:36:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:36:53 user nova-compute[75373]: FIRMWARE:
Nov 29 07:36:53 user nova-compute[75373]: No targets found.
Nov 29 07:36:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:36:53 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:36:53 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee53e63-56e8-468b-81a6-1be975dc804f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f20077-5c84-4840-8842-9a5e7d774516]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:36:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:36:53 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:36:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae02970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0371db92-d12f-4e4b-8f8e-6f16218112e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0ce67f-530f-4493-bad4-f2adcc148f7f]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4242fa-9659-4360-b33a-7b40d973fe07]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43840225-d801-439c-955e-5dc9b165edae]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf1b6b-5dbe-4e82-b5fc-17d9428645cb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770e4f0-3cc0-4c6c-95ef-92e25f6029f7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260]
Nov 29 07:36:53 user nova-compute[75373]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef, portal: 172.16.0.220,3260] successful.
Nov 29 07:36:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:36:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=24.950420379638672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de1f005-e019-463e-ad53-82c9095e62ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc540a74-55cc-455e-8e22-d682953abdae]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.701s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] <== disconnect_volume: return (703ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:36:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Deleting instance files /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_del
Nov 29 07:36:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Deletion of /opt/stack/data/nova/instances/f44b466e-2b87-414a-a4f7-d951d0a015c3_del complete
Nov 29 07:36:53 user nova-compute[75373]: INFO nova.compute.manager [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Took 1.67 seconds to destroy the instance on the hypervisor.
Nov 29 07:36:53 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:36:53 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 844be7c0-d83d-401f-9c62-bca197bf1683 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f44b466e-2b87-414a-a4f7-d951d0a015c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a3110d67-e063-488c-a284-a8beac872c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 1f34909f-b01d-49e9-af42-194e75572607 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] Acquiring lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] No waiting events found dispatching network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:54 user nova-compute[75373]: WARNING nova.compute.manager [req-a1dfffb6-57a0-4dbb-9bb5-5c959912a25a req-bc1002c0-12c4-4e0c-b0b3-9155b6b9bf15 service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received unexpected event network-vif-plugged-68cb76a9-e30c-4470-97d6-9e028490a7fe for instance with vm_state active and task_state deleting.
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.918s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:54 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Took 0.81 seconds to deallocate network for instance.
Nov 29 07:36:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-ee0a375e-d25a-4710-ac6d-14b8b061360b req-062b37aa-8171-4c8b-b593-51d10ad62fef service nova] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Received event network-vif-deleted-68cb76a9-e30c-4470-97d6-9e028490a7fe {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:55 user nova-compute[75373]: INFO nova.compute.manager [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] [instance: f44b466e-2b87-414a-a4f7-d951d0a015c3] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 07:36:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:55 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:56 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:56 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Deleted allocations for instance f44b466e-2b87-414a-a4f7-d951d0a015c3
Nov 29 07:36:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e44f6832-efe0-4e64-803d-52836a6e18e5 tempest-ServerActionsTestOtherB-1291056582 tempest-ServerActionsTestOtherB-1291056582-project-member] Lock "f44b466e-2b87-414a-a4f7-d951d0a015c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.900s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:57 user nova-compute[75373]: INFO nova.compute.manager [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Terminating instance
Nov 29 07:36:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-d94a0ac2-653f-44e9-94fa-ed43f5ef1b16 req-4f6454c3-5a3f-451d-bbc3-47dc03614e2f service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-unplugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Instance destroyed successfully.
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 6aff3409-81c6-4c41-9a03-8f4abfb318c9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-622522295',display_name='tempest-ServerRescueNegativeTestJSON-server-622522295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-622522295',id=5,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-o5yu09jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:22:45Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=6aff3409-81c6-4c41-9a03-8f4abfb318c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "address": "fa:16:3e:76:bb:fa", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6722af-05", "ovs_interfaceid": "1f6722af-05ac-4430-92df-0f566d4c9ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG os_vif [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6722af-05, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f60a72c3-7437-455e-b925-42c60fd46873) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:36:58 user nova-compute[75373]: INFO os_vif [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:bb:fa,bridge_name='br-int',has_traffic_filtering=True,id=1f6722af-05ac-4430-92df-0f566d4c9ef4,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6722af-05')
Nov 29 07:36:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Deleting instance files /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9_del
Nov 29 07:36:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Deletion of /opt/stack/data/nova/instances/6aff3409-81c6-4c41-9a03-8f4abfb318c9_del complete
Nov 29 07:36:58 user nova-compute[75373]: INFO nova.compute.manager [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 07:36:58 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:36:58 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:36:59 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Took 0.76 seconds to deallocate network for instance.
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] Acquiring lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] No waiting events found dispatching network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:36:59 user nova-compute[75373]: WARNING nova.compute.manager [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received unexpected event network-vif-plugged-1f6722af-05ac-4430-92df-0f566d4c9ef4 for instance with vm_state deleted and task_state None.
Nov 29 07:36:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-55887b00-3467-4afd-8c78-20d55c21ec13 req-596e488b-4a4d-47d2-8ee1-c847ccc17686 service nova] [instance: 6aff3409-81c6-4c41-9a03-8f4abfb318c9] Received event network-vif-deleted-1f6722af-05ac-4430-92df-0f566d4c9ef4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:36:59 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Deleted allocations for instance 6aff3409-81c6-4c41-9a03-8f4abfb318c9
Nov 29 07:36:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-42d9c9ca-501d-4080-9933-20d51723f1a2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "6aff3409-81c6-4c41-9a03-8f4abfb318c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.498s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:13 user nova-compute[75373]: INFO nova.compute.manager [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Unshelving
Nov 29 07:37:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_requests' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'numa_topology' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:13 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:37:13 user nova-compute[75373]: INFO nova.compute.claims [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Claim successful on node user
Nov 29 07:37:14 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:14 user nova-compute[75373]: INFO nova.network.neutron [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:37:14 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing instance network info cache due to event network-changed-9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] Acquiring lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:37:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Creating image(s)
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] Acquired lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Refreshing network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG nova.objects.base [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<4aa9a315-093e-44d7-8574-dcc3230b5479> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "ba587c688997f94a30a181a290260229a917a2f1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "ba587c688997f94a30a181a290260229a917a2f1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG nova.virt.images [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] b129cece-c7ce-4290-a94e-dcc4e2e4e4f6 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.part /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updated VIF entry in instance network info cache for port 9d1d3229-da55-4194-89a0-3ad8b6a21c0d. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc8af877-7eb7-4ac2-994a-944f4890b5ae req-1bfbe5e0-b003-4ebe-a26b-5ad541950cd5 service nova] Releasing lock "refresh_cache-4aa9a315-093e-44d7-8574-dcc3230b5479" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.part /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.converted" returned: 0 in 0.302s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "ba587c688997f94a30a181a290260229a917a2f1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.741s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "ba587c688997f94a30a181a290260229a917a2f1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "ba587c688997f94a30a181a290260229a917a2f1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1,backing_fmt=raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1,backing_fmt=raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk 1073741824" returned: 0 in 0.049s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "ba587c688997f94a30a181a290260229a917a2f1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'migration_context' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG nova.objects.base [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<4aa9a315-093e-44d7-8574-dcc3230b5479> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:37:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Rebasing disk image.
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 -F raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 -F raw /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk" returned: 0 in 2.328s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Ensure instance console log exists: /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start _get_guest_xml network_info=[{"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d3b2c84e1ff70fa00e2b8ac4e72ce8b3',container_format='bare',created_at=2023-11-29T07:35:21Z,direct_url=<?>,disk_format='qcow2',id=b129cece-c7ce-4290-a94e-dcc4e2e4e4f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-517026649-shelved',owner='c7fb2c66f2ee4df08d54238965f90bc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:35:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:37:20 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:37:20 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d3b2c84e1ff70fa00e2b8ac4e72ce8b3',container_format='bare',created_at=2023-11-29T07:35:21Z,direct_url=<?>,disk_format='qcow2',id=b129cece-c7ce-4290-a94e-dcc4e2e4e4f6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-517026649-shelved',owner='c7fb2c66f2ee4df08d54238965f90bc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T07:35:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<4aa9a315-093e-44d7-8574-dcc3230b5479> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='b129cece-c7ce-4290-a94e-dcc4e2e4e4f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-586193429',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:33:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:35:25.671367',shelved_host='user',shelved_image_id='b129cece-c7ce-4290-a94e-dcc4e2e4e4f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'pci_devices' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Object Instance<4aa9a315-093e-44d7-8574-dcc3230b5479> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:37:20 user nova-compute[75373]:   <uuid>4aa9a315-093e-44d7-8574-dcc3230b5479</uuid>
Nov 29 07:37:20 user nova-compute[75373]:   <name>instance-0000001f</name>
Nov 29 07:37:20 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:37:20 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:37:20 user nova-compute[75373]:   <metadata>
Nov 29 07:37:20 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:37:20 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-517026649</nova:name>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:37:20</nova:creationTime>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:37:20 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:37:20 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:owner>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:user uuid="6d67f374467c43e1b247a4fbc69e67d0">tempest-AttachVolumeShelveTestJSON-1812012148-project-member</nova:user>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:project uuid="c7fb2c66f2ee4df08d54238965f90bc6">tempest-AttachVolumeShelveTestJSON-1812012148</nova:project>
Nov 29 07:37:20 user nova-compute[75373]:       </nova:owner>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:root type="image" uuid="b129cece-c7ce-4290-a94e-dcc4e2e4e4f6"/>
Nov 29 07:37:20 user nova-compute[75373]:       <nova:ports>
Nov 29 07:37:20 user nova-compute[75373]:         <nova:port uuid="9d1d3229-da55-4194-89a0-3ad8b6a21c0d">
Nov 29 07:37:20 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:37:20 user nova-compute[75373]:         </nova:port>
Nov 29 07:37:20 user nova-compute[75373]:       </nova:ports>
Nov 29 07:37:20 user nova-compute[75373]:     </nova:instance>
Nov 29 07:37:20 user nova-compute[75373]:   </metadata>
Nov 29 07:37:20 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:37:20 user nova-compute[75373]:     <system>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="serial">4aa9a315-093e-44d7-8574-dcc3230b5479</entry>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="uuid">4aa9a315-093e-44d7-8574-dcc3230b5479</entry>
Nov 29 07:37:20 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:37:20 user nova-compute[75373]:     </system>
Nov 29 07:37:20 user nova-compute[75373]:   </sysinfo>
Nov 29 07:37:20 user nova-compute[75373]:   <os>
Nov 29 07:37:20 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:37:20 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:37:20 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:37:20 user nova-compute[75373]:   </os>
Nov 29 07:37:20 user nova-compute[75373]:   <features>
Nov 29 07:37:20 user nova-compute[75373]:     <acpi/>
Nov 29 07:37:20 user nova-compute[75373]:     <apic/>
Nov 29 07:37:20 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:37:20 user nova-compute[75373]:   </features>
Nov 29 07:37:20 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:37:20 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:37:20 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:37:20 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:37:20 user nova-compute[75373]:   </clock>
Nov 29 07:37:20 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:37:20 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:37:20 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:37:20 user nova-compute[75373]:   </cpu>
Nov 29 07:37:20 user nova-compute[75373]:   <devices>
Nov 29 07:37:20 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:37:20 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:37:20 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk"/>
Nov 29 07:37:20 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:37:20 user nova-compute[75373]:     </disk>
Nov 29 07:37:20 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:37:20 user nova-compute[75373]:       <mac address="fa:16:3e:cd:bd:31"/>
Nov 29 07:37:20 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:37:20 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:37:20 user nova-compute[75373]:       <target dev="tap9d1d3229-da"/>
Nov 29 07:37:20 user nova-compute[75373]:     </interface>
Nov 29 07:37:20 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:37:20 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/console.log" append="off"/>
Nov 29 07:37:20 user nova-compute[75373]:     </serial>
Nov 29 07:37:20 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:37:20 user nova-compute[75373]:     <video>
Nov 29 07:37:20 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:37:20 user nova-compute[75373]:     </video>
Nov 29 07:37:20 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:37:20 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:37:20 user nova-compute[75373]:     </rng>
Nov 29 07:37:20 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:37:20 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:37:20 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:37:20 user nova-compute[75373]:     </memballoon>
Nov 29 07:37:20 user nova-compute[75373]:   </devices>
Nov 29 07:37:20 user nova-compute[75373]: </domain>
Nov 29 07:37:20 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='b129cece-c7ce-4290-a94e-dcc4e2e4e4f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-586193429',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:33:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member',shelved_at='2023-11-29T07:35:25.671367',shelved_host='user',shelved_image_id='b129cece-c7ce-4290-a94e-dcc4e2e4e4f6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG os_vif [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c596fa8e-c38f-5b7d-82ba-8106cee01c7c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d1d3229-da, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d1d3229-da, col_values=(('qos', UUID('cd048078-8d53-4947-baf8-2561bf3df961')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d1d3229-da, col_values=(('external_ids', {'iface-id': '9d1d3229-da55-4194-89a0-3ad8b6a21c0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:bd:31', 'vm-uuid': '4aa9a315-093e-44d7-8574-dcc3230b5479'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:20 user nova-compute[75373]: INFO os_vif [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da')
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] No VIF found with MAC fa:16:3e:cd:bd:31, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:37:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:37:22 user nova-compute[75373]: WARNING nova.compute.manager [req-923fcba8-d5d8-4108-bd20-01516efe7863 req-aea95a31-9e49-415a-96b5-eca9d1aa1455 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 07:37:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:37:24 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance spawned successfully.
Nov 29 07:37:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:37:24 user nova-compute[75373]: WARNING nova.compute.manager [req-7b90cfb4-6389-4fd4-a665-779ae799431d req-5ac99b42-0c3c-4ad3-bc30-bc5d0854d031 service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 07:37:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:37:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3bf23225-2b6f-4326-a6fb-1f7ee2fb2473 tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.574s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:37:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:37:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:37:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [{"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-715c4151-deed-43c5-b786-6368742953d3" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-changed-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Refreshing instance network info cache due to event network-changed-90430c7f-41a9-48c1-9c6d-d09d03eab9ce. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] Acquiring lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] Acquired lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.network.neutron [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Refreshing network info cache for port 90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Ignoring supplied device name: /dev/vdb
Nov 29 07:37:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:43 user nova-compute[75373]: INFO nova.compute.manager [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Attaching volume 91166972-d19e-4cf2-9816-9df8d573fa53 to /dev/vdb
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.utils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7dc74-2400-4f86-95f5-05d4b7047d88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ce88f-42fd-41cf-966f-00767275f5d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f82274-556d-414f-b5d7-512a6a548aaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa665d-4974-4af2-83a3-933a85251e92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG nova.network.neutron [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updated VIF entry in instance network info cache for port 90430c7f-41a9-48c1-9c6d-d09d03eab9ce. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG nova.network.neutron [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updating instance_info_cache with network_info: [{"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:37:43 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b9296-be31-429a-b7a3-8420e3c13189]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG os_brick.utils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updating existing volume attachment record: d3cfee49-bce1-4cf4-b6bf-4f94178fe922 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:37:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a9d0d65-abac-4c16-8cdd-5375f76a0d4e req-c2b80d37-7179-4761-a5df-d19fa8fb735f service nova] Releasing lock "refresh_cache-a3110d67-e063-488c-a284-a8beac872c26" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:37:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:45 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:47 user nova-compute[75373]: INFO nova.compute.manager [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Terminating instance
Nov 29 07:37:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-408d3fdb-d12f-4100-8dbb-d772e53201a2 req-806b2a66-1586-4093-ab3c-93d19c5a35ba service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-unplugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:37:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Instance destroyed successfully.
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lazy-loading 'resources' on Instance uuid 844be7c0-d83d-401f-9c62-bca197bf1683 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-357729244',display_name='tempest-ServerRescueNegativeTestJSON-server-357729244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-357729244',id=3,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4259f5c423c347c8b36a7594ccec40cc',ramdisk_id='',reservation_id='r-3n8vngq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1603259648',owner_user_name='tempest-ServerRescueNegativeTestJSON-1603259648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:27:28Z,user_data=None,user_id='333925d6528d4e68bd23098c2f3513e5',uuid=844be7c0-d83d-401f-9c62-bca197bf1683,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converting VIF {"id": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "address": "fa:16:3e:a1:da:97", "network": {"id": "5f2db320-9d62-4a21-8e9a-7ec64fe9f091", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-238271456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4259f5c423c347c8b36a7594ccec40cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36fe1fea-00", "ovs_interfaceid": "36fe1fea-00f2-41e9-9035-229c5d9222d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG os_vif [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36fe1fea-00, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba597204-1f5f-469a-b7d8-bf7285c4d964) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:48 user nova-compute[75373]: INFO os_vif [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:da:97,bridge_name='br-int',has_traffic_filtering=True,id=36fe1fea-00f2-41e9-9035-229c5d9222d6,network=Network(5f2db320-9d62-4a21-8e9a-7ec64fe9f091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36fe1fea-00')
Nov 29 07:37:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Deleting instance files /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683_del
Nov 29 07:37:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Deletion of /opt/stack/data/nova/instances/844be7c0-d83d-401f-9c62-bca197bf1683_del complete
Nov 29 07:37:48 user nova-compute[75373]: INFO nova.compute.manager [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 07:37:48 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:37:48 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:49 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Took 0.76 seconds to deallocate network for instance.
Nov 29 07:37:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4d97cba-877c-44a7-94de-fc85171d30bf req-e155f47f-1dae-42aa-bd29-74b2c825081d service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-deleted-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:37:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:49 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Deleted allocations for instance 844be7c0-d83d-401f-9c62-bca197bf1683
Nov 29 07:37:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd2c3db4-0b18-4279-8a3e-39c2818da2e2 tempest-ServerRescueNegativeTestJSON-1603259648 tempest-ServerRescueNegativeTestJSON-1603259648-project-member] Lock "844be7c0-d83d-401f-9c62-bca197bf1683" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] Acquiring lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] Lock "844be7c0-d83d-401f-9c62-bca197bf1683-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] No waiting events found dispatching network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:37:50 user nova-compute[75373]: WARNING nova.compute.manager [req-55d7f995-c23f-4309-aa6c-d3c3c7c79f60 req-1865708a-65a5-4dff-82c2-1dd812082422 service nova] [instance: 844be7c0-d83d-401f-9c62-bca197bf1683] Received unexpected event network-vif-plugged-36fe1fea-00f2-41e9-9035-229c5d9222d6 for instance with vm_state deleted and task_state None.
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiJmwhUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:37:51 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:37:51 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:37:51 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a15f51-d397-4bd3-b047-b7f92fc9ff5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:37:51 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a423f06-2bda-4fbc-87cd-320a100f16dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53] added
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c83727-69eb-40c3-9a94-0b15b8b82316]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50e08f-b929-4004-a458-be7708ce0732]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiJmwhUZ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiJmwhUZ" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[58566ce7-8289-454b-8dba-4450884f21cd]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiJmwhUZ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e29fc0-4ca1-449a-b477-68d3e0a02ca2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1901b62d-3bf0-4c12-b842-bc2772e30458]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db924695-a6f3-44af-a134-cc12f76c3b52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260]
Nov 29 07:37:51 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260] successful.
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e58e3d-ef97-49f5-85bc-692283874946]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7dd758-264e-48b5-960c-ff6fc904a3c8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:37:51 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da5ee93-f2be-47bc-99a3-d9895fbf05e6]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-changed-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Refreshing instance network info cache due to event network-changed-cded9c97-d5f1-449d-ad58-3c8c96040384. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] Acquiring lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] Acquired lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Refreshing network info cache for port cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiJmwhUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26365393265643836', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393265643836', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:37:52 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:37:52 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:37:52 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:37:52 user nova-compute[75373]:   <serial>91166972-d19e-4cf2-9816-9df8d573fa53</serial>
Nov 29 07:37:52 user nova-compute[75373]: </disk>
Nov 29 07:37:52 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] No VIF found with MAC fa:16:3e:35:39:72, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updated VIF entry in instance network info cache for port cded9c97-d5f1-449d-ad58-3c8c96040384. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating instance_info_cache with network_info: [{"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f9bb9638-78f5-46b4-98db-61d6b48da938 req-aae94005-05de-4eb7-b9df-1eb1b8477fed service nova] Releasing lock "refresh_cache-0d39f8bb-1f10-4e7b-bb5e-8207376b9747" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3eb592c2-652d-4fad-aab4-16f6610932b2 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.462s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:37:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:37:54 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7643MB free_disk=25.006385803222656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a3110d67-e063-488c-a284-a8beac872c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 1f34909f-b01d-49e9-af42-194e75572607 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4aa9a315-093e-44d7-8574-dcc3230b5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:55 user nova-compute[75373]: INFO nova.compute.manager [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attaching volume 8c37b2ca-f41c-4492-8555-27ac1eebb17c to /dev/vdb
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.utils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6586be-9435-4ed5-b563-17008d99cfc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae3955-d014-4d31-b220-94ef792bd6f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09daaaa-6633-4122-b0aa-a0b7589ecd22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc8391-2530-4b73-9c75-57b245358839]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:37:55 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:37:55 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9116c189-16e1-4185-8ac2-0d08656aa759]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG os_brick.utils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating existing volume attachment record: a1c6cb00-872f-4539-b577-6b37ad160778 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:37:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 715c4151-deed-43c5-b786-6368742953d3 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 7c25504f-ed6b-409c-8849-68c1ca27fe93 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid b65cbd1b-d24b-4fc1-91e0-57135fbc5aee {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 201b9ba5-fa23-4c43-8ca7-b55093c7b643 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "715c4151-deed-43c5-b786-6368742953d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "715c4151-deed-43c5-b786-6368742953d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:37:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:37:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:38:01 user nova-compute[75373]: INFO nova.compute.claims [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Claim successful on node user
Nov 29 07:38:01 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:38:01 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:38:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.policy [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '809d6d574ea2441a9a2c24be9c409139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db2b708cb1df4d2ea2536831e3d83206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:38:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Creating image(s)
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.166s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk 1073741824" returned: 0 in 0.051s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Successfully created port: c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.197s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:38:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Cannot resize image /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Ensure instance console log exists: /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKnVgDNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:03 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Successfully updated port: c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b716023-d5c0-45df-9bfb-9f963c84b91f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:38:03 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca8793-92a8-4a5c-a808-35fac92c1d60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c] added
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing instance network info cache due to event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7727a366-8e76-4ca0-9eb6-2d424c32ad65]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cf081-caf3-4758-af7d-0f86bba06221]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKnVgDNf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKnVgDNf" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e689510f-1c56-4662-a9dd-92c268797235]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKnVgDNf'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a9cda-6ce6-458c-869b-7d6aeb282223]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fbc5ce-e9ca-45ce-b1ab-b7c86eab03fb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d1c9c-a492-4820-88b1-2d25bb6d01ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260]
Nov 29 07:38:03 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d1539a-5700-4310-a5e4-86520002309e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b3b444-f2e9-4a69-9773-63f274900fb9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:03 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfb4b0-7bcd-4af4-8c21-3244e497d354]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKnVgDNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance network_info: |[{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start _get_guest_xml network_info=[{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:38:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1386571198',display_name='tempest-ServerStableDeviceRescueTest-server-1386571198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1386571198',id=37,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3gBi1mV/8pxaPbDcJaalYHnRU4Ag2AHamBhfWTe1ESUYqIjvCef5yCJfsldoX+hbSJttpQF2UFgwwJhUl/izFDQQE991o1JqeFoRM8ZNAXaN4koHXvjAOix/ChKdnIbg==',key_name='tempest-keypair-302191484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b708cb1df4d2ea2536831e3d83206',ramdisk_id='',reservation_id='r-8j44pxcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-977224491',owner_user_name='tempest-ServerStableDeviceRescueTest-977224491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='809d6d574ea2441a9a2c24be9c409139',uuid=b819f808-d0cf-4db5-89d6-5b3a2dfec6a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converting VIF {"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:38:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'pci_devices' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:38:04 user nova-compute[75373]:   <uuid>b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</uuid>
Nov 29 07:38:04 user nova-compute[75373]:   <name>instance-00000025</name>
Nov 29 07:38:04 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:38:04 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:38:04 user nova-compute[75373]:   <metadata>
Nov 29 07:38:04 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:38:04 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1386571198</nova:name>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:38:03</nova:creationTime>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:38:04 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:38:04 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:owner>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:user uuid="809d6d574ea2441a9a2c24be9c409139">tempest-ServerStableDeviceRescueTest-977224491-project-member</nova:user>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:project uuid="db2b708cb1df4d2ea2536831e3d83206">tempest-ServerStableDeviceRescueTest-977224491</nova:project>
Nov 29 07:38:04 user nova-compute[75373]:       </nova:owner>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:38:04 user nova-compute[75373]:       <nova:ports>
Nov 29 07:38:04 user nova-compute[75373]:         <nova:port uuid="c2fbaa44-3b2e-4473-b109-19a8e355ed59">
Nov 29 07:38:04 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:38:04 user nova-compute[75373]:         </nova:port>
Nov 29 07:38:04 user nova-compute[75373]:       </nova:ports>
Nov 29 07:38:04 user nova-compute[75373]:     </nova:instance>
Nov 29 07:38:04 user nova-compute[75373]:   </metadata>
Nov 29 07:38:04 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:38:04 user nova-compute[75373]:     <system>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="serial">b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</entry>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="uuid">b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</entry>
Nov 29 07:38:04 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:38:04 user nova-compute[75373]:     </system>
Nov 29 07:38:04 user nova-compute[75373]:   </sysinfo>
Nov 29 07:38:04 user nova-compute[75373]:   <os>
Nov 29 07:38:04 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:38:04 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:38:04 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:38:04 user nova-compute[75373]:   </os>
Nov 29 07:38:04 user nova-compute[75373]:   <features>
Nov 29 07:38:04 user nova-compute[75373]:     <acpi/>
Nov 29 07:38:04 user nova-compute[75373]:     <apic/>
Nov 29 07:38:04 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:38:04 user nova-compute[75373]:   </features>
Nov 29 07:38:04 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:38:04 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:38:04 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:38:04 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:38:04 user nova-compute[75373]:   </clock>
Nov 29 07:38:04 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:38:04 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:38:04 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:38:04 user nova-compute[75373]:   </cpu>
Nov 29 07:38:04 user nova-compute[75373]:   <devices>
Nov 29 07:38:04 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:38:04 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:38:04 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk"/>
Nov 29 07:38:04 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:38:04 user nova-compute[75373]:     </disk>
Nov 29 07:38:04 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:38:04 user nova-compute[75373]:       <mac address="fa:16:3e:92:40:cd"/>
Nov 29 07:38:04 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:38:04 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:38:04 user nova-compute[75373]:       <target dev="tapc2fbaa44-3b"/>
Nov 29 07:38:04 user nova-compute[75373]:     </interface>
Nov 29 07:38:04 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:38:04 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/console.log" append="off"/>
Nov 29 07:38:04 user nova-compute[75373]:     </serial>
Nov 29 07:38:04 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:38:04 user nova-compute[75373]:     <video>
Nov 29 07:38:04 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:38:04 user nova-compute[75373]:     </video>
Nov 29 07:38:04 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:38:04 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:38:04 user nova-compute[75373]:     </rng>
Nov 29 07:38:04 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:38:04 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:38:04 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:38:04 user nova-compute[75373]:     </memballoon>
Nov 29 07:38:04 user nova-compute[75373]:   </devices>
Nov 29 07:38:04 user nova-compute[75373]: </domain>
Nov 29 07:38:04 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1386571198',display_name='tempest-ServerStableDeviceRescueTest-server-1386571198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1386571198',id=37,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3gBi1mV/8pxaPbDcJaalYHnRU4Ag2AHamBhfWTe1ESUYqIjvCef5yCJfsldoX+hbSJttpQF2UFgwwJhUl/izFDQQE991o1JqeFoRM8ZNAXaN4koHXvjAOix/ChKdnIbg==',key_name='tempest-keypair-302191484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db2b708cb1df4d2ea2536831e3d83206',ramdisk_id='',reservation_id='r-8j44pxcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-977224491',owner_user_name='tempest-ServerStableDeviceRescueTest-977224491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='809d6d574ea2441a9a2c24be9c409139',uuid=b819f808-d0cf-4db5-89d6-5b3a2dfec6a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converting VIF {"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG os_vif [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92e72b3f-7660-5419-a5c9-6e83d8c66ea2', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2fbaa44-3b, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2fbaa44-3b, col_values=(('qos', UUID('1d9084cc-d4bf-487e-a335-2fc719ab1d82')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2fbaa44-3b, col_values=(('external_ids', {'iface-id': 'c2fbaa44-3b2e-4473-b109-19a8e355ed59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:40:cd', 'vm-uuid': 'b819f808-d0cf-4db5-89d6-5b3a2dfec6a5'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:04 user nova-compute[75373]: INFO os_vif [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b')
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No VIF found with MAC fa:16:3e:92:40:cd, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updated VIF entry in instance network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c7fdc5e3-67a7-4b11-bc7e-bdd0f60f083f req-cce32ffb-01a4-4557-aced-62cfe1854390 service nova] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26263353163623930', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263353163623930', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:38:04 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:04 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:38:04 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:04 user nova-compute[75373]:   <serial>8c37b2ca-f41c-4492-8555-27ac1eebb17c</serial>
Nov 29 07:38:04 user nova-compute[75373]: </disk>
Nov 29 07:38:04 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No VIF found with MAC fa:16:3e:de:a0:b1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d4ba891d-c4eb-4178-8e65-f0f6993d4bba tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.403s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.863s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:05 user nova-compute[75373]: WARNING nova.compute.manager [req-24fc9aaf-e14e-4300-9d61-9d48554904ef req-a8657b83-625d-4a10-99c8-652871f29508 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state building and task_state spawning.
Nov 29 07:38:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-changed-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Refreshing instance network info cache due to event network-changed-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] Acquiring lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] Acquired lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:38:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Refreshing network info cache for port 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updated VIF entry in instance network info cache for port 9fccea0d-42d5-4f4e-83ae-a2ac0b51d134. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updating instance_info_cache with network_info: [{"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d351eda-ab6e-4837-a88b-3122d023dc01 req-bd7c4410-5a07-490d-ab90-bdcf75ba9bb6 service nova] Releasing lock "refresh_cache-1f34909f-b01d-49e9-af42-194e75572607" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:07 user nova-compute[75373]: WARNING nova.compute.manager [req-9536b83c-0abf-4b9e-9233-b61bbfe01332 req-82fce9bd-50fa-4ca7-8948-c8f26ee39606 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state building and task_state spawning.
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:38:08 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance spawned successfully.
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:38:08 user nova-compute[75373]: INFO nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:38:08 user nova-compute[75373]: INFO nova.compute.manager [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Took 6.82 seconds to build instance.
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-40aaea50-a471-466c-987e-99e8b6a7dfcd tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.920s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG nova.objects.instance [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:08 user nova-compute[75373]: INFO nova.compute.manager [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attaching volume faa32487-2c29-4a92-9092-caf9bfa52e10 to /dev/vdc
Nov 29 07:38:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.utils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa37389-e6d1-48e1-a4bb-23f6a79ba339]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcffd20f-c618-40b4-9ea7-25318137524d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b96b7a-5722-463d-9545-933aff3319dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3471941-1a12-4ac7-a721-a0b81c0ffc3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:38:09 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa76211-c20a-4518-94e3-170e1fc465c7]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG os_brick.utils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating existing volume attachment record: bbab12b9-261c-4ba1-a2a7-44fe20844552 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:10 user nova-compute[75373]: INFO nova.compute.manager [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Attaching volume 0cf064e8-7beb-4625-a2ef-80c44e2e1b33 to /dev/vdb
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.utils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b6fb7-1320-400c-beb6-c55a2c19cd74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d012cee6-889c-49a6-abde-59f393417823]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018d295-a520-41e4-98a6-1cbb4ed18eb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177aa82-db5a-4852-84fb-685f7f1999b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:38:10 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:38:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e70b02-5f46-4719-9bb4-5d889f23a706]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG os_brick.utils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updating existing volume attachment record: e9e8c834-3aa5-4ce9-879e-65cb95342ab8 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:38:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:13 user nova-compute[75373]: INFO nova.compute.manager [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Detaching volume 91166972-d19e-4cf2-9816-9df8d573fa53
Nov 29 07:38:13 user nova-compute[75373]: INFO nova.virt.block_device [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Attempting to driver detach volume 91166972-d19e-4cf2-9816-9df8d573fa53 from mountpoint /dev/vdb
Nov 29 07:38:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Attempting to detach device vdb from instance a3110d67-e063-488c-a284-a8beac872c26 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:38:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:13 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:13 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:38:13 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:13 user nova-compute[75373]:   <serial>91166972-d19e-4cf2-9816-9df8d573fa53</serial>
Nov 29 07:38:13 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:13 user nova-compute[75373]: </disk>
Nov 29 07:38:13 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully detached device vdb from instance a3110d67-e063-488c-a284-a8beac872c26 from the persistent domain config.
Nov 29 07:38:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3110d67-e063-488c-a284-a8beac872c26 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:38:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:13 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:13 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:38:13 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:13 user nova-compute[75373]:   <serial>91166972-d19e-4cf2-9816-9df8d573fa53</serial>
Nov 29 07:38:13 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:13 user nova-compute[75373]: </disk>
Nov 29 07:38:13 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:14 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:38:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:16 user nova-compute[75373]: INFO nova.compute.manager [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Rescuing
Nov 29 07:38:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:38:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:38:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:38:16 user nova-compute[75373]: INFO nova.compute.manager [None req-3c25c343-2b92-4d5b-99b2-9438a382f937 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Get console output
Nov 29 07:38:16 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:38:17 user nova-compute[75373]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 07:38:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXLARMlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:17 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[333aef8a-b692-4b59-b3f5-f7d226f44497]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:38:17 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023eccf-ea98-4891-b5c0-9617330716c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10] added
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552d8ec-455f-4c30-8ecc-25df5968c3d3]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef176ec-2d27-4d96-aaf8-489debfc8ff6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXLARMlg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXLARMlg" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682a1b8-7982-45f5-99b5-c74b3ffa504f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXLARMlg'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea60d55-f5d1-4aba-9e78-b8a82e2fda61]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[393a901c-8940-412c-a66c-a7553b693918]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.compute.manager [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:17 user nova-compute[75373]: WARNING nova.compute.manager [req-e31b5b98-cd13-44bb-9f3d-955bd698915b req-ec61cbfa-4144-4d6c-b7f5-456d9d4bb44e service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state active and task_state rescuing.
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ab5cc-0703-4642-ae31-a5f68d0f5475]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260]
Nov 29 07:38:17 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance destroyed successfully.
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f65e9-223b-43ab-9794-67caa1fb7654]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Attempting a stable device rescue
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaa32e2-753e-4d71-be8c-9c55dedc8813]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:17 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:38:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Creating image(s)
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'trusted_certs' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d7fe6-e5ed-45a2-8f36-a70f524d372a]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXLARMlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.634s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== connect_volume: return (1637ms) {'type': 'block', 'scsi_wwn': '26432656165363261', 'path': '/dev/sdf'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432656165363261', 'path': '/dev/sdf'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGwnKxaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:18 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:18 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:18 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:38:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2e714b-5276-4011-9183-88d1873f70c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:38:19 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:38:19 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:19 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:38:19 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:38:19 user nova-compute[75373]:   <serial>faa32487-2c29-4a92-9092-caf9bfa52e10</serial>
Nov 29 07:38:19 user nova-compute[75373]: </disk>
Nov 29 07:38:19 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa92ce32-c1ff-4788-a266-242dca560fe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33] added
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f1eed-6f41-4d0b-8f31-a8e19f046aa4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[199de111-b148-414a-a089-2a3ecd0d3456]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGwnKxaT {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.images [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] b57dce68-d0b3-4c69-8148-f45f76208b89 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.part /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGwnKxaT" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd126fc-7c2d-403e-8b7c-2cb6c0600290]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGwnKxaT'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b5c75-f3e4-4401-abd5-cf5eeec5dde1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e50340a-b5cc-454d-b9e4-bb551253a7c1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0220f985-24c1-46c8-ad22-1a4d572da19f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260]
Nov 29 07:38:19 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c809bd-41af-44c3-9a7f-83030b040e23]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0772142-d85d-4002-b22c-1fe57a16a363]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9221bb79-806e-453e-ab94-aa71523606c5]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGwnKxaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] No VIF found with MAC fa:16:3e:de:a0:b1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.part /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.converted" returned: 0 in 0.551s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:19 user nova-compute[75373]: WARNING nova.compute.manager [req-fffa3b3b-9b63-4649-9a05-0de61a5bd7a5 req-058744ed-c21e-4f6b-a79e-59438ee11a70 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state active and task_state rescuing.
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-21adc9b9-d1b3-4d96-b5f7-1fdb4d3c6167 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.781s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.050s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1,backing_fmt=raw /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1,backing_fmt=raw /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue" returned: 0 in 0.147s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'migration_context' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<f711ec64-cda6-4ee9-bc54-32b2b34d2acd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start _get_guest_xml network_info=[{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:f6:66:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b57dce68-d0b3-4c69-8148-f45f76208b89', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f711ec64-cda6-4ee9-bc54-32b2b34d2acd', 'attached_at': '', 'detached_at': '', 'volume_id': '361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'serial': '361fe1f7-43f4-4a8d-8b31-bf1e01413d83'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cad0a50a-f005-459a-b8bc-45fa957dcf1a', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<f711ec64-cda6-4ee9-bc54-32b2b34d2acd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'numa_topology' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<f711ec64-cda6-4ee9-bc54-32b2b34d2acd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:38:20 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:20 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'vcpu_model' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<f711ec64-cda6-4ee9-bc54-32b2b34d2acd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:20 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23836393830393831', 'path': '/dev/sdg'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836393830393831', 'path': '/dev/sdg'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.090s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:20 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:20 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7666b46-efb4-46b3-9411-c6d6028b713b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BmYCvwjE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 07:38:20 user nova-compute[75373]: node.name = iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:38:20 user nova-compute[75373]: node.tpgt = -1
Nov 29 07:38:20 user nova-compute[75373]: node.startup = automatic
Nov 29 07:38:20 user nova-compute[75373]: node.leading_login = No
Nov 29 07:38:20 user nova-compute[75373]: iface.iscsi_ifacename = default
Nov 29 07:38:20 user nova-compute[75373]: iface.net_ifacename = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.ipaddress = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.prefix_len = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.hwaddress = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.transport_name = tcp
Nov 29 07:38:20 user nova-compute[75373]: iface.initiatorname = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.vlan_id = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.vlan_priority = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.vlan_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.iface_num = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.mtu = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.port = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.bootproto = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.subnet_mask = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.gateway = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_alt_client_id = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_dns = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_learn_iqn = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_vendor_id_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_vendor_id = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.dhcp_slp_da = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.fragmentation = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.gratuitous_arp = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.incoming_forwarding = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.tos_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.tos = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.ttl = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.delayed_ack = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.tcp_nagle = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.tcp_wsf_state = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.tcp_wsf = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.tcp_timer_scale = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.tcp_timestamp = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.redirect = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.def_task_mgmt_timeout = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.header_digest = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.data_digest = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.immediate_data = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.initial_r2t = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.data_seq_inorder = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.data_pdu_inorder = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.erl = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.max_receive_data_len = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.first_burst_len = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.max_outstanding_r2t = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.max_burst_len = 0
Nov 29 07:38:20 user nova-compute[75373]: iface.chap_auth = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.bidi_chap = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.strict_login_compliance = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.discovery_auth = <empty>
Nov 29 07:38:20 user nova-compute[75373]: iface.discovery_logout = <empty>
Nov 29 07:38:20 user nova-compute[75373]: node.discovery_address = <empty>
Nov 29 07:38:20 user nova-compute[75373]: node.discovery_port = 0
Nov 29 07:38:20 user nova-compute[75373]: node.discovery_type = static
Nov 29 07:38:20 user nova-compute[75373]: node.session.initial_cmdsn = 0
Nov 29 07:38:20 user nova-compute[75373]: node.session.initial_login_retry_max = 8
Nov 29 07:38:20 user nova-compute[75373]: node.session.xmit_thread_priority = -20
Nov 29 07:38:20 user nova-compute[75373]: node.session.cmds_max = 128
Nov 29 07:38:20 user nova-compute[75373]: node.session.queue_depth = 32
Nov 29 07:38:20 user nova-compute[75373]: node.session.nr_sessions = 1
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.authmethod = CHAP
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.username = BmYCvwjE
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.password = ***
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.username_in = <empty>
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.password_in = <empty>
Nov 29 07:38:20 user nova-compute[75373]: node.session.auth.chap_algs = MD5
Nov 29 07:38:20 user nova-compute[75373]: node.session.timeo.replacement_timeout = 120
Nov 29 07:38:20 user nova-compute[75373]: node.session.err_timeo.abort_timeout = 15
Nov 29 07:38:20 user nova-compute[75373]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 07:38:20 user nova-compute[75373]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 07:38:20 user nova-compute[75373]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.FastAbort = Yes
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.InitialR2T = No
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.ImmediateData = Yes
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.MaxConnections = 1
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 07:38:20 user nova-compute[75373]: node.session.iscsi.ERL = 0
Nov 29 07:38:20 user nova-compute[75373]: node.session.scan = manual
Nov 29 07:38:20 user nova-compute[75373]: node.session.reopen_max = 0
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].address = 172.16.0.220
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].port = 3260
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].startup = manual
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].tcp.window_size = 524288
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].tcp.type_of_service = 0
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].timeo.logout_timeout = 15
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].timeo.login_timeout = 15
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].timeo.auth_timeout = 45
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.DataDigest = None
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.IFMarker = No
Nov 29 07:38:20 user nova-compute[75373]: node.conn[0].iscsi.OFMarker = No
Nov 29 07:38:20 user nova-compute[75373]: # END RECORD
Nov 29 07:38:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:38:20 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:20 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:38:20 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:   <serial>0cf064e8-7beb-4625-a2ef-80c44e2e1b33</serial>
Nov 29 07:38:20 user nova-compute[75373]: </disk>
Nov 29 07:38:20 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7b41a-4166-40c2-b9d8-0ebac6d194ef]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13e1db-21cd-4721-91f3-282a1c1943f3]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmYCvwjE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BmYCvwjE" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb7e46-4d74-47ce-a8ab-75d79b835c35]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BmYCvwjE'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0273e2-3fdc-4e15-9242-a78d64ba33bf]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd90f6a-a8ab-488e-a562-036fff8b1021]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:20 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] HCTL ('34', '0', '0', 0) found on session 36 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:38:20 user nova-compute[75373]: INFO nova.compute.manager [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Detaching volume 8c37b2ca-f41c-4492-8555-27ac1eebb17c
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd09da5-382d-401c-8e1e-dd694041060d]: (4, ('0 0 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Searching for a device in session 36 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== connect_volume: return (308ms) {'type': 'block', 'scsi_wwn': '23433666639356363', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433666639356363', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1365733974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1365733974',id=36,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:36:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-q2ydo015',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:36:46Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=f711ec64-cda6-4ee9-bc54-32b2b34d2acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:f6:66:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "vif_mac": "fa:16:3e:f6:66:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'pci_devices' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:20 user nova-compute[75373]: INFO nova.virt.block_device [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attempting to driver detach volume 8c37b2ca-f41c-4492-8555-27ac1eebb17c from mountpoint /dev/vdb
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.objects.base [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Object Instance<f711ec64-cda6-4ee9-bc54-32b2b34d2acd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:38:20 user nova-compute[75373]:   <uuid>f711ec64-cda6-4ee9-bc54-32b2b34d2acd</uuid>
Nov 29 07:38:20 user nova-compute[75373]:   <name>instance-00000024</name>
Nov 29 07:38:20 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:38:20 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:38:20 user nova-compute[75373]:   <metadata>
Nov 29 07:38:20 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:38:20 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1365733974</nova:name>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:38:20</nova:creationTime>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:38:20 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:38:20 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:owner>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:user uuid="b7dec6d7789c4430ad19e175de4b3519">tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member</nova:user>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:project uuid="ff517549ee99421aa0e9d570d4fb6941">tempest-ServerBootFromVolumeStableRescueTest-1839777950</nova:project>
Nov 29 07:38:20 user nova-compute[75373]:       </nova:owner>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:38:20 user nova-compute[75373]:       <nova:ports>
Nov 29 07:38:20 user nova-compute[75373]:         <nova:port uuid="673cb70d-ed66-49b5-8d03-074b629d1f33">
Nov 29 07:38:20 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:38:20 user nova-compute[75373]:         </nova:port>
Nov 29 07:38:20 user nova-compute[75373]:       </nova:ports>
Nov 29 07:38:20 user nova-compute[75373]:     </nova:instance>
Nov 29 07:38:20 user nova-compute[75373]:   </metadata>
Nov 29 07:38:20 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:38:20 user nova-compute[75373]:     <system>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="serial">f711ec64-cda6-4ee9-bc54-32b2b34d2acd</entry>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="uuid">f711ec64-cda6-4ee9-bc54-32b2b34d2acd</entry>
Nov 29 07:38:20 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:38:20 user nova-compute[75373]:     </system>
Nov 29 07:38:20 user nova-compute[75373]:   </sysinfo>
Nov 29 07:38:20 user nova-compute[75373]:   <os>
Nov 29 07:38:20 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:38:20 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:38:20 user nova-compute[75373]:   </os>
Nov 29 07:38:20 user nova-compute[75373]:   <features>
Nov 29 07:38:20 user nova-compute[75373]:     <acpi/>
Nov 29 07:38:20 user nova-compute[75373]:     <apic/>
Nov 29 07:38:20 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:38:20 user nova-compute[75373]:   </features>
Nov 29 07:38:20 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:38:20 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:38:20 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:38:20 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:38:20 user nova-compute[75373]:   </clock>
Nov 29 07:38:20 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:38:20 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:38:20 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:38:20 user nova-compute[75373]:   </cpu>
Nov 29 07:38:20 user nova-compute[75373]:   <devices>
Nov 29 07:38:20 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:38:20 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:20 user nova-compute[75373]:       <source dev="/dev/sdc"/>
Nov 29 07:38:20 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:       <serial>361fe1f7-43f4-4a8d-8b31-bf1e01413d83</serial>
Nov 29 07:38:20 user nova-compute[75373]:     </disk>
Nov 29 07:38:20 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:38:20 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:38:20 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue"/>
Nov 29 07:38:20 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:       <boot order="1"/>
Nov 29 07:38:20 user nova-compute[75373]:     </disk>
Nov 29 07:38:20 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:38:20 user nova-compute[75373]:       <mac address="fa:16:3e:f6:66:15"/>
Nov 29 07:38:20 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:38:20 user nova-compute[75373]:       <target dev="tap673cb70d-ed"/>
Nov 29 07:38:20 user nova-compute[75373]:     </interface>
Nov 29 07:38:20 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:38:20 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/console.log" append="off"/>
Nov 29 07:38:20 user nova-compute[75373]:     </serial>
Nov 29 07:38:20 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:38:20 user nova-compute[75373]:     <video>
Nov 29 07:38:20 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:     </video>
Nov 29 07:38:20 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:38:20 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:38:20 user nova-compute[75373]:     </rng>
Nov 29 07:38:20 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:38:20 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:38:20 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:38:20 user nova-compute[75373]:     </memballoon>
Nov 29 07:38:20 user nova-compute[75373]:   </devices>
Nov 29 07:38:20 user nova-compute[75373]: </domain>
Nov 29 07:38:20 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Attempting to detach device vdb from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:20 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:20 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:38:20 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:   <serial>8c37b2ca-f41c-4492-8555-27ac1eebb17c</serial>
Nov 29 07:38:20 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:20 user nova-compute[75373]: </disk>
Nov 29 07:38:20 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdb from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the persistent domain config.
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:20 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:20 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:38:20 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:20 user nova-compute[75373]:   <serial>8c37b2ca-f41c-4492-8555-27ac1eebb17c</serial>
Nov 29 07:38:20 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:20 user nova-compute[75373]: </disk>
Nov 29 07:38:20 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance destroyed successfully.
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] No VIF found with MAC fa:16:3e:f6:66:15, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:38:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] No VIF found with MAC fa:16:3e:3c:5a:a1, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:38:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bd35c794-3a82-46f8-b648-5f0d2a402f8c tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.891s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:21 user nova-compute[75373]: INFO nova.compute.manager [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Detaching volume 0cf064e8-7beb-4625-a2ef-80c44e2e1b33
Nov 29 07:38:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:38:21 user nova-compute[75373]: INFO nova.virt.block_device [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Attempting to driver detach volume 0cf064e8-7beb-4625-a2ef-80c44e2e1b33 from mountpoint /dev/vdb
Nov 29 07:38:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Attempting to detach device vdb from instance 1f34909f-b01d-49e9-af42-194e75572607 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:38:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:21 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:21 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:38:21 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:21 user nova-compute[75373]:   <serial>0cf064e8-7beb-4625-a2ef-80c44e2e1b33</serial>
Nov 29 07:38:21 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:21 user nova-compute[75373]: </disk>
Nov 29 07:38:21 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:21 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 1f34909f-b01d-49e9-af42-194e75572607 from the persistent domain config.
Nov 29 07:38:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f34909f-b01d-49e9-af42-194e75572607 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:38:21 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:21 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:21 user nova-compute[75373]:   <source dev="/dev/sdg"/>
Nov 29 07:38:21 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:38:21 user nova-compute[75373]:   <serial>0cf064e8-7beb-4625-a2ef-80c44e2e1b33</serial>
Nov 29 07:38:21 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:38:21 user nova-compute[75373]: </disk>
Nov 29 07:38:21 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:38:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:23 user nova-compute[75373]: WARNING nova.compute.manager [req-0b18b011-938b-47f3-a7ec-40c9f8263a21 req-820330dc-c643-484c-a9ac-af3dcbc87ca6 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state active and task_state rescuing.
Nov 29 07:38:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cbe8b72d-b384-423b-80ac-95c302543bf0 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:25 user nova-compute[75373]: WARNING nova.compute.manager [req-c5550e5f-7766-424a-8c30-3c45091fbea1 req-63aa88b2-4a82-4eb7-9a0a-82e0910cf3ff service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state rescued and task_state None.
Nov 29 07:38:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:34 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3110d67-e063-488c-a284-a8beac872c26 is timed out.
Nov 29 07:38:34 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully detached device vdb from instance a3110d67-e063-488c-a284-a8beac872c26 from the live domain config.
Nov 29 07:38:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiJmwhUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:34 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[50614458-0018-443d-9d3c-59a64f7e3c99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:38:34 user nova-compute[75373]: No targets found.
Nov 29 07:38:34 user nova-compute[75373]: iSNS:
Nov 29 07:38:34 user nova-compute[75373]: No targets found.
Nov 29 07:38:34 user nova-compute[75373]: STATIC:
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:38:34 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:34 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:34 user nova-compute[75373]: FIRMWARE:
Nov 29 07:38:34 user nova-compute[75373]: No targets found.
Nov 29 07:38:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:38:34 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:38:34 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c80c3f-1451-4ba9-ae71-b4697615f4bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de2edc-95a4-4e8f-9476-4bc82848c132]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae057bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd101e3-f96c-4c89-b1a4-c1fe895b3440]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9966f0-95bf-4f16-baea-cffb7b6817a3]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0cac31-aef4-408a-9a27-bee171ff9f79]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[52278258-b6a8-4bad-9674-1e425b47da00]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0706d6f-bf27-4273-a56d-712e663c773b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9509e0c-29c7-44e9-b8e5-7aba5379c64d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260]
Nov 29 07:38:34 user nova-compute[75373]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:34 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217cba6-4e22-4781-bd8b-c45ed0f463e9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== disconnect_volume: return (358ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:34 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG nova.objects.instance [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'flavor' on Instance uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-354f2a06-d634-45d5-adcb-b2da77a09f9d tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.703s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:35 user nova-compute[75373]: INFO nova.compute.manager [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Terminating instance
Nov 29 07:38:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-unplugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] No waiting events found dispatching network-vif-unplugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-69653c01-020d-4b8c-b88b-08b77c13cb6e req-3ffeb495-ea44-44a9-a681-9a4cfb26552f service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-unplugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] Instance destroyed successfully.
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lazy-loading 'resources' on Instance uuid a3110d67-e063-488c-a284-a8beac872c26 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1684493719',display_name='tempest-VolumesSnapshotTestJSON-instance-1684493719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1684493719',id=33,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETxfWRHyvR4+74Jx0gE3EHt9tcsniUzAadM7WJ9syQUPHnKk8ZUgAqbJVRtM4sQjs8QCnkaAsSk5VVoRviVAB1sunBX/DHEnZvsZfmqrl1ux7LQMw7wg/8/qf797YkSMA==',key_name='tempest-keypair-1982178400',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65289e019d8a46efb9f46dd41358ed16',ramdisk_id='',reservation_id='r-fv78si0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-155394523',owner_user_name='tempest-VolumesSnapshotTestJSON-155394523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:35:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39b41ea8ed064f2e80ed67fde84b6456',uuid=a3110d67-e063-488c-a284-a8beac872c26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converting VIF {"id": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "address": "fa:16:3e:35:39:72", "network": {"id": "2025dadf-e40e-4672-a027-f8259638f1f2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-668447080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65289e019d8a46efb9f46dd41358ed16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90430c7f-41", "ovs_interfaceid": "90430c7f-41a9-48c1-9c6d-d09d03eab9ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_vif [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90430c7f-41, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c59cfded-480f-48e6-a9cf-80971d331e7e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:36 user nova-compute[75373]: INFO os_vif [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:39:72,bridge_name='br-int',has_traffic_filtering=True,id=90430c7f-41a9-48c1-9c6d-d09d03eab9ce,network=Network(2025dadf-e40e-4672-a027-f8259638f1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90430c7f-41')
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiJmwhUZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:36 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f39a27e-b30d-48e4-9f0d-ac551c03dfd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:38:36 user nova-compute[75373]: No targets found.
Nov 29 07:38:36 user nova-compute[75373]: iSNS:
Nov 29 07:38:36 user nova-compute[75373]: No targets found.
Nov 29 07:38:36 user nova-compute[75373]: STATIC:
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:38:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:36 user nova-compute[75373]: FIRMWARE:
Nov 29 07:38:36 user nova-compute[75373]: No targets found.
Nov 29 07:38:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:38:36 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:38:36 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91166972-d19e-4cf2-9816-9df8d573fa53', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b53bbf-2f50-44b9-a41e-b88ae0ea6ec2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11432f-5765-42fd-a048-45424e9589bd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0294ca0>, {}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Disconnecting from: [] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] <== disconnect_volume: return (94ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:38:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Deleting instance files /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26_del
Nov 29 07:38:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Deletion of /opt/stack/data/nova/instances/a3110d67-e063-488c-a284-a8beac872c26_del complete
Nov 29 07:38:36 user nova-compute[75373]: INFO nova.compute.manager [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 07:38:36 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:38:36 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:37 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: a3110d67-e063-488c-a284-a8beac872c26] Took 1.18 seconds to deallocate network for instance.
Nov 29 07:38:37 user nova-compute[75373]: WARNING nova.volume.cinder [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Attachment d3cfee49-bce1-4cf4-b6bf-4f94178fe922 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d3cfee49-bce1-4cf4-b6bf-4f94178fe922. (HTTP 404) (Request-ID: req-ba309811-d4da-4a8e-ac3a-9fb91bfd6cd2)
Nov 29 07:38:37 user nova-compute[75373]: INFO nova.compute.manager [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] [instance: a3110d67-e063-488c-a284-a8beac872c26] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] Acquiring lock "a3110d67-e063-488c-a284-a8beac872c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] Lock "a3110d67-e063-488c-a284-a8beac872c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] No waiting events found dispatching network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:38:37 user nova-compute[75373]: WARNING nova.compute.manager [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received unexpected event network-vif-plugged-90430c7f-41a9-48c1-9c6d-d09d03eab9ce for instance with vm_state deleted and task_state None.
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-571793d6-418f-4284-babb-dc388af75f2c req-bbb5d134-41e3-47ca-83e7-a25c53547a34 service nova] [instance: a3110d67-e063-488c-a284-a8beac872c26] Received event network-vif-deleted-90430c7f-41a9-48c1-9c6d-d09d03eab9ce {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:38:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:37 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Deleted allocations for instance a3110d67-e063-488c-a284-a8beac872c26
Nov 29 07:38:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d9e9f0c7-0aa2-428c-a600-c293ff4cdcd4 tempest-VolumesSnapshotTestJSON-155394523 tempest-VolumesSnapshotTestJSON-155394523-project-member] Lock "a3110d67-e063-488c-a284-a8beac872c26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:41 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 is timed out.
Nov 29 07:38:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdb from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the live domain config.
Nov 29 07:38:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKnVgDNf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:41 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffb7d7-5214-4393-a93b-18396d3627f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:38:41 user nova-compute[75373]: No targets found.
Nov 29 07:38:41 user nova-compute[75373]: iSNS:
Nov 29 07:38:41 user nova-compute[75373]: No targets found.
Nov 29 07:38:41 user nova-compute[75373]: STATIC:
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:38:41 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:41 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:41 user nova-compute[75373]: FIRMWARE:
Nov 29 07:38:41 user nova-compute[75373]: No targets found.
Nov 29 07:38:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:38:41 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:38:41 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dc31ea-1f6b-4ad1-9361-60d38738a304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8dfe81-a629-4a17-83d7-b2a5bd080732]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b00767d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526a692-0287-4a9a-b348-4a683e2b501d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c40816-9d0b-41e0-a83c-fc2294559288]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cde50de-b8a5-4c31-ba12-ed4c8eaf01b2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5ac25b-8611-4389-b86b-099c86cc6021]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8490eb-29f4-42ec-96b4-fcdcf75be879]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef4e7f7-7fb9-4bf3-bddb-62ef8f379cd6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260]
Nov 29 07:38:41 user nova-compute[75373]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c37b2ca-f41c-4492-8555-27ac1eebb17c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e79bd-a608-461e-aaec-14f7e3acf710]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== disconnect_volume: return (321ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:38:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:38:42 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f34909f-b01d-49e9-af42-194e75572607 is timed out.
Nov 29 07:38:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully detached device vdb from instance 1f34909f-b01d-49e9-af42-194e75572607 from the live domain config.
Nov 29 07:38:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGwnKxaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:38:42 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56fae9-2c0e-451c-a8b4-dae0726b4bba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:38:42 user nova-compute[75373]: No targets found.
Nov 29 07:38:42 user nova-compute[75373]: iSNS:
Nov 29 07:38:42 user nova-compute[75373]: No targets found.
Nov 29 07:38:42 user nova-compute[75373]: STATIC:
Nov 29 07:38:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:38:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:38:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33
Nov 29 07:38:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:38:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:38:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:38:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:38:42 user nova-compute[75373]: FIRMWARE:
Nov 29 07:38:42 user nova-compute[75373]: No targets found.
Nov 29 07:38:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:38:42 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:38:42 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[94115693-c848-4b79-a400-bd5e4471940b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79896cbc-d320-4ee2-b3c8-ddfb9b16b017]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 (non-flash)
Nov 29 07:38:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08930430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33'): ({'sdg'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Removing single pathed devices sdg {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdf26c3-30c9-40af-bb16-23efd6df79d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa8a72-08d7-4140-a4ad-def227ce4df7]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Flushing IO for device /dev/sdg {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b5b2d-b0b9-43e5-83d0-b7d706ce38c4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5321c5-1dc5-4ef7-ae54-c2121c2870fd]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] SCSI volumes sdg have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3860a004-48a5-4f23-827a-ff3fd9d5db31]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3fbb5-e5ae-44ef-9c53-cf42984de40a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260]
Nov 29 07:38:42 user nova-compute[75373]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33, portal: 172.16.0.220,3260] successful.
Nov 29 07:38:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cf064e8-7beb-4625-a2ef-80c44e2e1b33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd76f504-c296-4dba-acc4-857307ce0964]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] <== disconnect_volume: return (306ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG nova.objects.instance [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0114c70-1111-4932-9a59-ca2c7c293a1e tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.085s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:43 user nova-compute[75373]: INFO nova.compute.manager [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Detaching volume faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:38:43 user nova-compute[75373]: INFO nova.virt.block_device [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Attempting to driver detach volume faa32487-2c29-4a92-9092-caf9bfa52e10 from mountpoint /dev/vdc
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Attempting to detach device vdc from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:43 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:43 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:38:43 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:38:43 user nova-compute[75373]:   <serial>faa32487-2c29-4a92-9092-caf9bfa52e10</serial>
Nov 29 07:38:43 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:38:43 user nova-compute[75373]: </disk>
Nov 29 07:38:43 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdc from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the persistent domain config.
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:38:43 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:38:43 user nova-compute[75373]:   <source dev="/dev/sdf"/>
Nov 29 07:38:43 user nova-compute[75373]:   <target dev="vdc" bus="virtio"/>
Nov 29 07:38:43 user nova-compute[75373]:   <serial>faa32487-2c29-4a92-9092-caf9bfa52e10</serial>
Nov 29 07:38:43 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 07:38:43 user nova-compute[75373]: </disk>
Nov 29 07:38:43 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.objects.instance [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'flavor' on Instance uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8a82b49f-eeef-4be2-8b15-61ef6c67e862 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.943s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:38:45 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:38:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:38:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:38:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:38:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:55 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=24.897254943847656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 1f34909f-b01d-49e9-af42-194e75572607 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4aa9a315-093e-44d7-8574-dcc3230b5479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:38:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:38:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 is timed out.
Nov 29 07:39:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully detached device vdc from instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 from the live domain config.
Nov 29 07:39:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXLARMlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:39:03 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c736dd4-90c2-41b0-8ce2-de8b29d747bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:39:03 user nova-compute[75373]: No targets found.
Nov 29 07:39:03 user nova-compute[75373]: iSNS:
Nov 29 07:39:03 user nova-compute[75373]: No targets found.
Nov 29 07:39:03 user nova-compute[75373]: STATIC:
Nov 29 07:39:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10
Nov 29 07:39:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:39:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:39:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:03 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:39:03 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:03 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:03 user nova-compute[75373]: FIRMWARE:
Nov 29 07:39:03 user nova-compute[75373]: No targets found.
Nov 29 07:39:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:39:03 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:39:03 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca3baba-ae9b-46ad-9668-b96b3f0ac285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad4880-b8ff-4ae2-bd4c-000811b955bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 (non-flash)
Nov 29 07:39:03 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0294f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10'): ({'sdf'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Removing single pathed devices sdf {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5bcca-cf9e-4515-8d31-a3d0f8778b3a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fb01a2-1841-4320-85dd-a423e6d56332]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Flushing IO for device /dev/sdf {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14e814-1fa8-4801-9f8c-f6d685e8329f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09f4a1-0fc7-4bf6-a8a6-ec9a34e9deec]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] SCSI volumes sdf have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:39:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0093a-1410-4fbd-840e-3822e21b6be6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d3278-e1ff-49e7-b8d1-dc3680374fc1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260]
Nov 29 07:39:04 user nova-compute[75373]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10, portal: 172.16.0.220,3260] successful.
Nov 29 07:39:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faa32487-2c29-4a92-9092-caf9bfa52e10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3fcf7-6543-4ebe-8e8b-41572dca5ae1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] <== disconnect_volume: return (330ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:04 user nova-compute[75373]: INFO nova.compute.manager [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Terminating instance
Nov 29 07:39:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:39:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'flavor' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a19e59ba-b648-416b-bcd6-a004991e49f1 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-a9006fe6-3216-4426-8749-921866545e25 req-030d302e-2df0-40b8-9fcf-656f6ff9fa3f service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-unplugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:39:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Instance destroyed successfully.
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lazy-loading 'resources' on Instance uuid 4aa9a315-093e-44d7-8574-dcc3230b5479 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-517026649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-517026649',id=31,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdZLW/8UHXJjA1ttw+Y8X7Z/m4nn+EiW4I7qaqgAtvuvUTc2reY5VvUEYdvx3LoaaLitBNrr2eCoxiBLerCPFCdeR7MQMq0f01D4FIcD8AzuWNQNas1YNDG1kwGx3n2Qg==',key_name='tempest-keypair-586193429',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:37:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7fb2c66f2ee4df08d54238965f90bc6',ramdisk_id='',reservation_id='r-utx0p20b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1812012148',owner_user_name='tempest-AttachVolumeShelveTestJSON-1812012148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:37:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d67f374467c43e1b247a4fbc69e67d0',uuid=4aa9a315-093e-44d7-8574-dcc3230b5479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converting VIF {"id": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "address": "fa:16:3e:cd:bd:31", "network": {"id": "d7836d75-9729-4ce1-85dd-2c1cc09434a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1775976445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7fb2c66f2ee4df08d54238965f90bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d1d3229-da", "ovs_interfaceid": "9d1d3229-da55-4194-89a0-3ad8b6a21c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG os_vif [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d1d3229-da, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd048078-8d53-4947-baf8-2561bf3df961) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:05 user nova-compute[75373]: INFO os_vif [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bd:31,bridge_name='br-int',has_traffic_filtering=True,id=9d1d3229-da55-4194-89a0-3ad8b6a21c0d,network=Network(d7836d75-9729-4ce1-85dd-2c1cc09434a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d1d3229-da')
Nov 29 07:39:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Deleting instance files /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479_del
Nov 29 07:39:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Deletion of /opt/stack/data/nova/instances/4aa9a315-093e-44d7-8574-dcc3230b5479_del complete
Nov 29 07:39:05 user nova-compute[75373]: INFO nova.compute.manager [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 29 07:39:05 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:39:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:06 user nova-compute[75373]: INFO nova.compute.manager [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Terminating instance
Nov 29 07:39:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:06 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:06 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Took 1.29 seconds to deallocate network for instance.
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Instance destroyed successfully.
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lazy-loading 'resources' on Instance uuid 0d39f8bb-1f10-4e7b-bb5e-8207376b9747 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492767153',display_name='tempest-AttachVolumeTestJSON-server-492767153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492767153',id=34,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdIqg4ojCpm4KdzunfdKo/5yNRQ9a/vBqyI9dB9/r5U/16FADRCxKmeYCDysVwcQJHZUhUO9gtUflQk4BiBi0zBdcVVcklYlroRoFtWd/9NHN2fL4KBnNiTtHrC5BuD6Q==',key_name='tempest-keypair-1089222370',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:36:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='249771bcbe724be3ac7c15231dd07e45',ramdisk_id='',reservation_id='r-7d86do01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1182766882',owner_user_name='tempest-AttachVolumeTestJSON-1182766882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f571f40d066b4d198fcf6d49c22ad1c1',uuid=0d39f8bb-1f10-4e7b-bb5e-8207376b9747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converting VIF {"id": "cded9c97-d5f1-449d-ad58-3c8c96040384", "address": "fa:16:3e:de:a0:b1", "network": {"id": "09414ea7-2e5f-4e62-bcf7-b3d3c352bfce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1233207249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "249771bcbe724be3ac7c15231dd07e45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcded9c97-d5", "ovs_interfaceid": "cded9c97-d5f1-449d-ad58-3c8c96040384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG os_vif [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcded9c97-d5, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26339768-5461-41c8-a84b-1ee0d0c8b44e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:07 user nova-compute[75373]: INFO os_vif [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a0:b1,bridge_name='br-int',has_traffic_filtering=True,id=cded9c97-d5f1-449d-ad58-3c8c96040384,network=Network(09414ea7-2e5f-4e62-bcf7-b3d3c352bfce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcded9c97-d5')
Nov 29 07:39:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Deleting instance files /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747_del
Nov 29 07:39:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Deletion of /opt/stack/data/nova/instances/0d39f8bb-1f10-4e7b-bb5e-8207376b9747_del complete
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Acquiring lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] No waiting events found dispatching network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:07 user nova-compute[75373]: WARNING nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received unexpected event network-vif-plugged-9d1d3229-da55-4194-89a0-3ad8b6a21c0d for instance with vm_state deleted and task_state None.
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-unplugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] No waiting events found dispatching network-vif-unplugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-unplugged-cded9c97-d5f1-449d-ad58-3c8c96040384 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 4aa9a315-093e-44d7-8574-dcc3230b5479] Received event network-vif-deleted-9d1d3229-da55-4194-89a0-3ad8b6a21c0d {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Acquiring lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] No waiting events found dispatching network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:07 user nova-compute[75373]: WARNING nova.compute.manager [req-450b0c84-5264-47db-a5ff-f6205c8ac325 req-44e590b4-483c-4f46-913c-e081564b981c service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received unexpected event network-vif-plugged-cded9c97-d5f1-449d-ad58-3c8c96040384 for instance with vm_state active and task_state deleting.
Nov 29 07:39:07 user nova-compute[75373]: INFO nova.compute.manager [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:07 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Deleted allocations for instance 4aa9a315-093e-44d7-8574-dcc3230b5479
Nov 29 07:39:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e9db3c5b-585b-4539-baca-8ee72251d45a tempest-AttachVolumeShelveTestJSON-1812012148 tempest-AttachVolumeShelveTestJSON-1812012148-project-member] Lock "4aa9a315-093e-44d7-8574-dcc3230b5479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:08 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:08 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Took 1.13 seconds to deallocate network for instance.
Nov 29 07:39:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:08 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:39:08 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:39:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:09 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Deleted allocations for instance 0d39f8bb-1f10-4e7b-bb5e-8207376b9747
Nov 29 07:39:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-90778817-d31a-4246-8fee-c809f866db81 tempest-AttachVolumeTestJSON-1182766882 tempest-AttachVolumeTestJSON-1182766882-project-member] Lock "0d39f8bb-1f10-4e7b-bb5e-8207376b9747" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.750s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-b75f7583-7426-48f0-ae1d-ed272876179f req-13b02efc-b797-40f8-9aef-3d6b668ac3ae service nova] [instance: 0d39f8bb-1f10-4e7b-bb5e-8207376b9747] Received event network-vif-deleted-cded9c97-d5f1-449d-ad58-3c8c96040384 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:11 user nova-compute[75373]: INFO nova.compute.manager [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Terminating instance
Nov 29 07:39:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-unplugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] No waiting events found dispatching network-vif-unplugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-48ee8c1a-c6bf-4c58-b8fd-12a5ac6126c3 req-6b181af2-9fbc-475b-8c4a-bbe5d8ff2ec1 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-unplugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Instance destroyed successfully.
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.objects.instance [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lazy-loading 'resources' on Instance uuid 1f34909f-b01d-49e9-af42-194e75572607 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188350420',display_name='tempest-AttachVolumeNegativeTest-server-188350420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188350420',id=35,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwaXBsz5yOlnRKwJg7MXHN33z4nhqnZVUrpxoifnlYpQPOw8dEgStjbq8BH6k/gHwE+hMkff1yv4pFX1KvIqkX/CYz88eTe48EtNq6kvn9lTTBtH4nQoKrYAXBBhgsWlw==',key_name='tempest-keypair-981803260',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc32b5fe43b84c2b9df54631c7a3edb9',ramdisk_id='',reservation_id='r-rb24kiqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2030774109',owner_user_name='tempest-AttachVolumeNegativeTest-2030774109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:36:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fa1e258308644589a58d3ba9b99d09a',uuid=1f34909f-b01d-49e9-af42-194e75572607,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converting VIF {"id": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "address": "fa:16:3e:3c:5a:a1", "network": {"id": "e4c28fed-ad1c-445a-874e-ac24a362f9d6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1713205003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc32b5fe43b84c2b9df54631c7a3edb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fccea0d-42", "ovs_interfaceid": "9fccea0d-42d5-4f4e-83ae-a2ac0b51d134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG os_vif [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fccea0d-42, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b71363a-7d4f-4ecb-8b27-64b6812b835e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:12 user nova-compute[75373]: INFO os_vif [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:5a:a1,bridge_name='br-int',has_traffic_filtering=True,id=9fccea0d-42d5-4f4e-83ae-a2ac0b51d134,network=Network(e4c28fed-ad1c-445a-874e-ac24a362f9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fccea0d-42')
Nov 29 07:39:12 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Deleting instance files /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607_del
Nov 29 07:39:12 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Deletion of /opt/stack/data/nova/instances/1f34909f-b01d-49e9-af42-194e75572607_del complete
Nov 29 07:39:12 user nova-compute[75373]: INFO nova.compute.manager [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 07:39:12 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:39:12 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:39:13 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:13 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Took 0.84 seconds to deallocate network for instance.
Nov 29 07:39:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:13 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:39:13 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:39:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:13 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Deleted allocations for instance 1f34909f-b01d-49e9-af42-194e75572607
Nov 29 07:39:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-afd1c6bd-ddad-45b7-97e6-8599e87a4c60 tempest-AttachVolumeNegativeTest-2030774109 tempest-AttachVolumeNegativeTest-2030774109-project-member] Lock "1f34909f-b01d-49e9-af42-194e75572607" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] Acquiring lock "1f34909f-b01d-49e9-af42-194e75572607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] Lock "1f34909f-b01d-49e9-af42-194e75572607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] No waiting events found dispatching network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:14 user nova-compute[75373]: WARNING nova.compute.manager [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received unexpected event network-vif-plugged-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 for instance with vm_state deleted and task_state None.
Nov 29 07:39:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-9e463478-dafc-4f1b-9813-315896c71169 req-1ac888eb-c8bb-44e8-a783-47697f9b7571 service nova] [instance: 1f34909f-b01d-49e9-af42-194e75572607] Received event network-vif-deleted-9fccea0d-42d5-4f4e-83ae-a2ac0b51d134 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:17 user nova-compute[75373]: INFO nova.compute.manager [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Terminating instance
Nov 29 07:39:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-14be981a-4d62-4fbb-abfb-91344c904e09 req-46b9365e-7b3e-4ada-807f-4334db552447 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-unplugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:39:18 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Instance destroyed successfully.
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'resources' on Instance uuid b65cbd1b-d24b-4fc1-91e0-57135fbc5aee {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:32:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-45594249',display_name='tempest-ServerActionsTestOtherA-server-45594249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-45594249',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:34:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-rm4yabuz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:36:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=b65cbd1b-d24b-4fc1-91e0-57135fbc5aee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "2f1e556a-b9d0-480b-9b30-c6335010a583", "address": "fa:16:3e:ac:25:31", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f1e556a-b9", "ovs_interfaceid": "2f1e556a-b9d0-480b-9b30-c6335010a583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_vif [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f1e556a-b9, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64068f7f-cfd9-43b3-ad5d-d9e91c7bb025) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:18 user nova-compute[75373]: INFO os_vif [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:25:31,bridge_name='br-int',has_traffic_filtering=True,id=2f1e556a-b9d0-480b-9b30-c6335010a583,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f1e556a-b9')
Nov 29 07:39:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zunNDFeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:39:18 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f2fff-a499-49e3-9944-30223a0867b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:39:18 user nova-compute[75373]: No targets found.
Nov 29 07:39:18 user nova-compute[75373]: iSNS:
Nov 29 07:39:18 user nova-compute[75373]: No targets found.
Nov 29 07:39:18 user nova-compute[75373]: STATIC:
Nov 29 07:39:18 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:39:18 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:18 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:18 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf
Nov 29 07:39:18 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:18 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:18 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:39:18 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:39:18 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:39:18 user nova-compute[75373]: FIRMWARE:
Nov 29 07:39:18 user nova-compute[75373]: No targets found.
Nov 29 07:39:18 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:39:18 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:39:18 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1528ae1-a3b7-4ced-be86-619a15999ffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68ad38-d696-404d-b4a1-974c48ecec85]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:39:18 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:39:18 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:39:18 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:39:18 user nova-compute[75373]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf (non-flash)
Nov 29 07:39:18 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:39:18 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08931a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf'): ({'sdh'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Removing single pathed devices sdh {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e684f-d199-45b9-b6c4-b429fcdde285]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1fa23b-3491-47c9-b77c-cf7a558bfa37]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Flushing IO for device /dev/sdh {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[98180e88-d084-445b-aa05-0951ea56cf21]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:39:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5485de55-b78e-42fe-880c-12e62555d3bf]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] SCSI volumes sdh have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bada75-3f4c-40b4-868e-c761d6769f6c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8deac54-b1c6-42a8-9e69-988ee2aa2c78]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260]
Nov 29 07:39:19 user nova-compute[75373]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf, portal: 172.16.0.220,3260] successful.
Nov 29 07:39:19 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81fb0c39-194f-411c-bd10-df1ce47e0dbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3dd1af-4be2-4240-a270-f7d85070087f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] <== disconnect_volume: return (386ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:39:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Deleting instance files /opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee_del
Nov 29 07:39:19 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Deletion of /opt/stack/data/nova/instances/b65cbd1b-d24b-4fc1-91e0-57135fbc5aee_del complete
Nov 29 07:39:19 user nova-compute[75373]: INFO nova.compute.manager [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 29 07:39:19 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:39:19 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] Acquiring lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] No waiting events found dispatching network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:39:20 user nova-compute[75373]: WARNING nova.compute.manager [req-b21a4a30-c558-4358-be58-31fb731ce531 req-e8d88df0-db76-4f93-9b49-9dde10782602 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received unexpected event network-vif-plugged-2f1e556a-b9d0-480b-9b30-c6335010a583 for instance with vm_state active and task_state deleting.
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:20 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Took 1.17 seconds to deallocate network for instance.
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-7668d185-c092-41f3-ab51-7c8d700a58e3 req-1ef72688-f094-4f9f-96dd-653928f53391 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Received event network-vif-deleted-2f1e556a-b9d0-480b-9b30-c6335010a583 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:20 user nova-compute[75373]: INFO nova.compute.manager [req-7668d185-c092-41f3-ab51-7c8d700a58e3 req-1ef72688-f094-4f9f-96dd-653928f53391 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Neutron deleted interface 2f1e556a-b9d0-480b-9b30-c6335010a583; detaching it from the instance and deleting it from the info cache
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-7668d185-c092-41f3-ab51-7c8d700a58e3 req-1ef72688-f094-4f9f-96dd-653928f53391 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-7668d185-c092-41f3-ab51-7c8d700a58e3 req-1ef72688-f094-4f9f-96dd-653928f53391 service nova] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Detach interface failed, port_id=2f1e556a-b9d0-480b-9b30-c6335010a583, reason: Instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:39:21 user nova-compute[75373]: INFO nova.compute.manager [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 07:39:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: b65cbd1b-d24b-4fc1-91e0-57135fbc5aee] Deleting volume: 81fb0c39-194f-411c-bd10-df1ce47e0dbf {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:39:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:21 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:39:21 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:39:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:21 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Deleted allocations for instance b65cbd1b-d24b-4fc1-91e0-57135fbc5aee
Nov 29 07:39:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a0a8d39c-0930-43ca-b0fb-3a516489a305 tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "b65cbd1b-d24b-4fc1-91e0-57135fbc5aee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.933s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:39:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:39:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:39:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:39:42 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [{"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-5de96a96-0082-43fa-a18d-be40468c6c8d" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:39:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:39:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:39:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing instance network info cache due to event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updated VIF entry in instance network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:39:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1c53e1a-523e-4ce4-849b-96fd0ad8b0a2 req-3adf2439-eab8-4f42-9d6a-54c886b140c7 service nova] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:39:53 user nova-compute[75373]: INFO nova.compute.manager [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] instance snapshotting
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Beginning live snapshot process
Nov 29 07:39:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json -f qcow2 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.203s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079.delta 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079.delta 1073741824" returned: 0 in 0.047s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 07:39:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:39:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8311MB free_disk=24.97608184814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75373) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 07:39:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079.delta /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 715c4151-deed-43c5-b786-6368742953d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:39:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:39:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079.delta /opt/stack/data/nova/instances/snapshots/tmp6_sc8j8p/4f8b11b97a574d5386bf3f58046a1079" returned: 0 in 0.769s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:39:57 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Snapshot extracted, beginning image upload
Nov 29 07:39:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:39:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Snapshot image upload complete
Nov 29 07:40:00 user nova-compute[75373]: INFO nova.compute.manager [None req-74e16476-9b68-48b9-ac55-843980804180 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Took 6.14 seconds to snapshot the instance on the hypervisor.
Nov 29 07:40:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:40:06 user nova-compute[75373]: INFO nova.compute.claims [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Claim successful on node user
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:40:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:40:07 user nova-compute[75373]: INFO nova.virt.block_device [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Booting with volume 79e139fa-917d-47a7-8f29-e7dc84ecbfe2 at /dev/vda
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.policy [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f1e0b9fc9c74de2b0fc76b85ad16af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47faf322a2e4f75bb17ff43013a863e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.utils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e5f16-0188-491b-b8cf-e717f1730a82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[74485b4c-2ab3-435e-a1bd-ecd80303da9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:07 user nova-compute[75373]: INFO nova.compute.manager [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Unrescuing
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquired lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[623a7a0d-141b-403d-a628-40089b81583f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f9bf5-b4ef-4ad6-8262-d5112cc22eaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:40:07 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:40:07 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1944be7-5d95-4a48-95fc-dc77cebf2262]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG os_brick.utils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:40:07 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating existing volume attachment record: 8b410d98-8d95-44a9-ad67-97d866065bf9 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG nova.network.neutron [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [{"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Releasing lock "refresh_cache-f711ec64-cda6-4ee9-bc54-32b2b34d2acd" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG nova.objects.instance [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'flavor' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Successfully created port: e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:08 user nova-compute[75373]: WARNING nova.compute.manager [req-8089162a-abcf-4619-8e32-261e47fc8ac3 req-6aa3d39b-41ad-46d0-8d6d-c5390807eb89 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:08 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance destroyed successfully.
Nov 29 07:40:09 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Successfully updated port: e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing instance network info cache due to event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:40:09 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.network.neutron [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance network_info: |[{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:10 user nova-compute[75373]: WARNING nova.compute.manager [req-cd0def3c-0827-4eaf-ab37-54acf7486884 req-175e9fda-1bed-48b2-a561-377ce04a6239 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updated VIF entry in instance network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-68359ca6-9498-4325-aa84-03aef297cb4a req-ace27d06-8e25-499f-8b12-3f93b681a98a service nova] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:12 user nova-compute[75373]: WARNING nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:40:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:12 user nova-compute[75373]: WARNING nova.compute.manager [req-0b718628-2f47-47f6-8a60-bd60f75e7f7a req-b10e14d8-db8d-4a6c-a52d-cc7f9ba096bd service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:40:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-4f0cc75c-525e-4d5a-92a5-4d09f1646a24 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:40:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:14 user nova-compute[75373]: INFO nova.compute.manager [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Terminating instance
Nov 29 07:40:14 user nova-compute[75373]: DEBUG nova.compute.manager [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-unplugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] No waiting events found dispatching network-vif-unplugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-ea54c050-e456-4fe4-9342-d11af8f6877f req-a7402866-b997-4baf-b847-8131efeb5440 service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-unplugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:40:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] Instance destroyed successfully.
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lazy-loading 'resources' on Instance uuid 715c4151-deed-43c5-b786-6368742953d3 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-786024452',display_name='tempest-ServerActionsTestOtherA-server-786024452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-786024452',id=4,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ5ch0O561D+60jqoh2NnRNy4zqKFHin6mtOQobQ0CGe11Q5eIZ16l1MV7hTMfZo+80mo16YGS8+T4FlUVMP3UK/gBULRXE+60BdJ6rHYFOfZkm2e/JXjNCui+Cp1y4QQ==',key_name='tempest-keypair-37621614',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:21:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3f10657321e44f49a30fedbe20dddcf',ramdisk_id='',reservation_id='r-vu28zxcv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1926007529',owner_user_name='tempest-ServerActionsTestOtherA-1926007529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd3d603a0cab4a7da1c743c26b73540d',uuid=715c4151-deed-43c5-b786-6368742953d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converting VIF {"id": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "address": "fa:16:3e:06:0a:92", "network": {"id": "77704883-ad6c-42e5-8c6f-30786b329853", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-656402222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f10657321e44f49a30fedbe20dddcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86bb9a6e-6e", "ovs_interfaceid": "86bb9a6e-6e20-4552-8f0f-ca84e2995b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG os_vif [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86bb9a6e-6e, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da064686-bf28-442a-b69a-392bc2e4f47d) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:40:15 user nova-compute[75373]: INFO os_vif [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21,network=Network(77704883-ad6c-42e5-8c6f-30786b329853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86bb9a6e-6e')
Nov 29 07:40:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Deleting instance files /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3_del
Nov 29 07:40:15 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Deletion of /opt/stack/data/nova/instances/715c4151-deed-43c5-b786-6368742953d3_del complete
Nov 29 07:40:15 user nova-compute[75373]: INFO nova.compute.manager [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] [instance: 715c4151-deed-43c5-b786-6368742953d3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 07:40:15 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-c195f2cc-a641-4ca1-a3a4-4b5084016016 req-69e5dcf3-8589-46e1-9960-0ebf1e89feaa service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-deleted-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:16 user nova-compute[75373]: INFO nova.compute.manager [req-c195f2cc-a641-4ca1-a3a4-4b5084016016 req-69e5dcf3-8589-46e1-9960-0ebf1e89feaa service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Neutron deleted interface 86bb9a6e-6e20-4552-8f0f-ca84e2995b21; detaching it from the instance and deleting it from the info cache
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.network.neutron [req-c195f2cc-a641-4ca1-a3a4-4b5084016016 req-69e5dcf3-8589-46e1-9960-0ebf1e89feaa service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-c195f2cc-a641-4ca1-a3a4-4b5084016016 req-69e5dcf3-8589-46e1-9960-0ebf1e89feaa service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Detach interface failed, port_id=86bb9a6e-6e20-4552-8f0f-ca84e2995b21, reason: Instance 715c4151-deed-43c5-b786-6368742953d3 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:40:16 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 715c4151-deed-43c5-b786-6368742953d3] Took 1.32 seconds to deallocate network for instance.
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] Acquiring lock "715c4151-deed-43c5-b786-6368742953d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] Lock "715c4151-deed-43c5-b786-6368742953d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] No waiting events found dispatching network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:16 user nova-compute[75373]: WARNING nova.compute.manager [req-e97856c0-81ae-4c13-a9eb-a8cec7efc619 req-5e391f4b-b74b-4236-9341-b30359194dbd service nova] [instance: 715c4151-deed-43c5-b786-6368742953d3] Received unexpected event network-vif-plugged-86bb9a6e-6e20-4552-8f0f-ca84e2995b21 for instance with vm_state deleted and task_state None.
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:40:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Creating image(s)
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Ensure instance console log exists: /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start _get_guest_xml network_info=[{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f66de8ab-d248-4064-a13a-8c7d9a81aff9', 'attached_at': '', 'detached_at': '', 'volume_id': '79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'serial': '79e139fa-917d-47a7-8f29-e7dc84ecbfe2'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '8b410d98-8d95-44a9-ad67-97d866065bf9', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:40:16 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:40:16 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:40:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:40:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:40:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:40:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:40:17 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:40:17 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[711e480e-0a51-46a5-a64e-396157b16e74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:40:17 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[664da868-c243-4b43-b625-dbaa8316f2d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2] added
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6585c0-969a-43f1-85d8-518b4f2853b2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Deleted allocations for instance 715c4151-deed-43c5-b786-6368742953d3
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f011172e-a739-4c00-875a-886d440c972b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfbkuSRq {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfbkuSRq" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79160e-1650-4966-8f8f-e5ce44d1de83]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfbkuSRq'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[14370283-8b1b-4b74-8885-fbd61b320717]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2b15de5-d371-41d0-b6f1-67c15193340e tempest-ServerActionsTestOtherA-1926007529 tempest-ServerActionsTestOtherA-1926007529-project-member] Lock "715c4151-deed-43c5-b786-6368742953d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.015s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86135f8-cd9d-43d6-bec2-93aedb70c46e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d8e57-abc2-4850-b84b-1fb2d22abff7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]
Nov 29 07:40:17 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5eed00-3d49-49e3-b2bd-dce4f87dd73a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e9d4c-12ff-4cdf-8e42-c810b2d71876]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:40:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1f75fe-789b-45f8-bad6-1b610fa6811a]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:40:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23065633339356539', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633339356539', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCePht6phlCj5AAAtGEeqWHlduphWnWp6IPt44audw7zKbVTtGgNmcQ4RsT3H6ZTD+2L7nN48T1uPfiFsgfjEiUHd3TPGATSqfy05hE7bYqmBvylKMJnCcmK1s/BJIYX3g==',key_name='tempest-TestShelveInstance-573824224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:40:07Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'pci_devices' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:40:18 user nova-compute[75373]:   <uuid>f66de8ab-d248-4064-a13a-8c7d9a81aff9</uuid>
Nov 29 07:40:18 user nova-compute[75373]:   <name>instance-00000026</name>
Nov 29 07:40:18 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:40:18 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:40:18 user nova-compute[75373]:   <metadata>
Nov 29 07:40:18 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:40:18 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:40:18 user nova-compute[75373]:       <nova:name>tempest-TestShelveInstance-server-1814460307</nova:name>
Nov 29 07:40:18 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:40:16</nova:creationTime>
Nov 29 07:40:18 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:40:18 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:40:18 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:40:18 user nova-compute[75373]:       <nova:owner>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:user uuid="6f1e0b9fc9c74de2b0fc76b85ad16af0">tempest-TestShelveInstance-885872690-project-member</nova:user>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:project uuid="d47faf322a2e4f75bb17ff43013a863e">tempest-TestShelveInstance-885872690</nova:project>
Nov 29 07:40:18 user nova-compute[75373]:       </nova:owner>
Nov 29 07:40:18 user nova-compute[75373]:       <nova:ports>
Nov 29 07:40:18 user nova-compute[75373]:         <nova:port uuid="e7980c5b-bb5d-42b0-baa4-36c5f9863c9e">
Nov 29 07:40:18 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 07:40:18 user nova-compute[75373]:         </nova:port>
Nov 29 07:40:18 user nova-compute[75373]:       </nova:ports>
Nov 29 07:40:18 user nova-compute[75373]:     </nova:instance>
Nov 29 07:40:18 user nova-compute[75373]:   </metadata>
Nov 29 07:40:18 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:40:18 user nova-compute[75373]:     <system>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="serial">f66de8ab-d248-4064-a13a-8c7d9a81aff9</entry>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="uuid">f66de8ab-d248-4064-a13a-8c7d9a81aff9</entry>
Nov 29 07:40:18 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:40:18 user nova-compute[75373]:     </system>
Nov 29 07:40:18 user nova-compute[75373]:   </sysinfo>
Nov 29 07:40:18 user nova-compute[75373]:   <os>
Nov 29 07:40:18 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:40:18 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:40:18 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:40:18 user nova-compute[75373]:   </os>
Nov 29 07:40:18 user nova-compute[75373]:   <features>
Nov 29 07:40:18 user nova-compute[75373]:     <acpi/>
Nov 29 07:40:18 user nova-compute[75373]:     <apic/>
Nov 29 07:40:18 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:40:18 user nova-compute[75373]:   </features>
Nov 29 07:40:18 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:40:18 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:40:18 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:40:18 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:40:18 user nova-compute[75373]:   </clock>
Nov 29 07:40:18 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:40:18 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:40:18 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:40:18 user nova-compute[75373]:   </cpu>
Nov 29 07:40:18 user nova-compute[75373]:   <devices>
Nov 29 07:40:18 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:40:18 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:40:18 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:40:18 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:40:18 user nova-compute[75373]:       <serial>79e139fa-917d-47a7-8f29-e7dc84ecbfe2</serial>
Nov 29 07:40:18 user nova-compute[75373]:     </disk>
Nov 29 07:40:18 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:40:18 user nova-compute[75373]:       <mac address="fa:16:3e:67:ed:8c"/>
Nov 29 07:40:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:40:18 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:40:18 user nova-compute[75373]:       <target dev="tape7980c5b-bb"/>
Nov 29 07:40:18 user nova-compute[75373]:     </interface>
Nov 29 07:40:18 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:40:18 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9/console.log" append="off"/>
Nov 29 07:40:18 user nova-compute[75373]:     </serial>
Nov 29 07:40:18 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:40:18 user nova-compute[75373]:     <video>
Nov 29 07:40:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:40:18 user nova-compute[75373]:     </video>
Nov 29 07:40:18 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:40:18 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:40:18 user nova-compute[75373]:     </rng>
Nov 29 07:40:18 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:40:18 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:40:18 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:40:18 user nova-compute[75373]:     </memballoon>
Nov 29 07:40:18 user nova-compute[75373]:   </devices>
Nov 29 07:40:18 user nova-compute[75373]: </domain>
Nov 29 07:40:18 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCePht6phlCj5AAAtGEeqWHlduphWnWp6IPt44audw7zKbVTtGgNmcQ4RsT3H6ZTD+2L7nN48T1uPfiFsgfjEiUHd3TPGATSqfy05hE7bYqmBvylKMJnCcmK1s/BJIYX3g==',key_name='tempest-TestShelveInstance-573824224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:40:07Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG os_vif [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1408df5-b3b0-5d9b-8aec-f7f69063f3ce', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7980c5b-bb, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7980c5b-bb, col_values=(('qos', UUID('3f132463-a4d7-446f-8043-ba518e1a0b92')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7980c5b-bb, col_values=(('external_ids', {'iface-id': 'e7980c5b-bb5d-42b0-baa4-36c5f9863c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:ed:8c', 'vm-uuid': 'f66de8ab-d248-4064-a13a-8c7d9a81aff9'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:18 user nova-compute[75373]: INFO os_vif [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb')
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:40:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] No VIF found with MAC fa:16:3e:67:ed:8c, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:40:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:20 user nova-compute[75373]: WARNING nova.compute.manager [req-91ce12e7-a797-4abe-8337-b187ae5371dc req-c1352929-af8f-4fc7-8f6c-2618da1e754a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state building and task_state spawning.
Nov 29 07:40:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:40:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance spawned successfully.
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:40:22 user nova-compute[75373]: INFO nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:40:22 user nova-compute[75373]: INFO nova.compute.manager [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Took 15.79 seconds to build instance.
Nov 29 07:40:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-844d3720-d796-49e9-b3a4-09778ce5ea15 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.933s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:40:22 user nova-compute[75373]: WARNING nova.compute.manager [req-8769f7d8-b491-441f-9dd1-0c669e1e1531 req-b7a1775e-b788-411e-b600-632a66f19afc service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state active and task_state None.
Nov 29 07:40:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:41 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:41 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:40:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:40:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:40:41 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:40:42 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updating instance_info_cache with network_info: [{"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:40:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-201b9ba5-fa23-4c43-8ca7-b55093c7b643" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:40:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:40:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:48 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:50 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:40:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:40:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:40:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:40:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=24.916282653808594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f66de8ab-d248-4064-a13a-8c7d9a81aff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:40:56 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:40:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:40:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:40:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:40:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:41:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'flavor' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:45 user nova-compute[75373]: INFO nova.compute.manager [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attaching volume 27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e to /dev/vdb
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.utils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77bea73-e01d-43dd-9edf-e388320c17df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0a2c25-34a2-4d4a-a511-0dcd8572bd18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79146422-75ba-4073-83c1-5e9311bd1b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6af9c2b-a64d-4a93-9ec2-5c48ccd00b5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:41:45 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:41:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0380739-76c5-49aa-8feb-f4a73ad43866]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG os_brick.utils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:41:45 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating existing volume attachment record: 25078a71-db5e-490b-92b4-28777af4b637 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:41:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:41:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:41:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:41:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:41:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:41:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:41:54 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:41:54 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:41:54 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03360a87-8b05-4cd4-8d81-15d86da85152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:41:54 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b5187-cce4-4158-a1b5-23f5db3035a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e] added
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd23f6ff-2395-48ea-a3a4-63ebf71bc82d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca8db71-195f-47ab-b13a-2f06ea3c1503]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLGXNoIP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLGXNoIP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9248c6de-9319-4956-b7be-8a2f61b50edf]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLGXNoIP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[678182ab-2419-4f88-bd44-22257ded0e70]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8537d53-f3d4-4250-bcc0-995952bac268]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e3b030-9e29-411e-8c13-20986d806c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260]
Nov 29 07:41:54 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260] successful.
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7292609b-2437-4eaf-aa41-d9f80e108b76]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eab8a0-a683-4b9d-bdcf-4fe47b92421d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:41:54 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:41:54 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5b2749-2cb1-4f31-aeff-77f53b49123f]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:41:55 user nova-compute[75373]: INFO nova.compute.claims [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Claim successful on node user
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23063316161666438', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063316161666438', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'flavor' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:41:55 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:41:55 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:41:55 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:41:55 user nova-compute[75373]:   <serial>27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e</serial>
Nov 29 07:41:55 user nova-compute[75373]: </disk>
Nov 29 07:41:55 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:41:55 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:41:55 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Creating image(s)
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "/opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "/opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.077s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.policy [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52c5144f378a4912b225fff6bf91ffe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1623cf95d2344ee6855e7e283edeacf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.242s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.547s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No VIF found with MAC fa:16:3e:92:40:cd, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:41:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:41:56 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:41:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=24.901504516601562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk 1073741824" returned: 0 in 0.070s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.622s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccc7c97f-2c91-4502-bf0c-1d193565b91b tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.439s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f66de8ab-d248-4064-a13a-8c7d9a81aff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Successfully created port: 79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Cannot resize image /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Ensure instance console log exists: /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:41:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:58 user nova-compute[75373]: INFO nova.compute.manager [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Rescuing
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Successfully updated port: 79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquired lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-changed-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Refreshing instance network info cache due to event network-changed-79929b03-efa4-401c-9a9c-a77e34ff68b9. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] Acquiring lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Updating instance_info_cache with network_info: [{"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Releasing lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Instance network_info: |[{"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] Acquired lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Refreshing network info cache for port 79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Start _get_guest_xml network_info=[{"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:41:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:41:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1986969278',display_name='tempest-VolumesNegativeTest-instance-1986969278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1986969278',id=39,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1623cf95d2344ee6855e7e283edeacf8',ramdisk_id='',reservation_id='r-1qkqtryl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1539683747',owner_user_name='tempest-VolumesNegativeTest-1539683747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:41:56Z,user_data=None,user_id='52c5144f378a4912b225fff6bf91ffe5',uuid=e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converting VIF {"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lazy-loading 'pci_devices' on Instance uuid e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:41:58 user nova-compute[75373]:   <uuid>e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80</uuid>
Nov 29 07:41:58 user nova-compute[75373]:   <name>instance-00000027</name>
Nov 29 07:41:58 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:41:58 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:41:58 user nova-compute[75373]:   <metadata>
Nov 29 07:41:58 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:41:58 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:name>tempest-VolumesNegativeTest-instance-1986969278</nova:name>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:41:58</nova:creationTime>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:41:58 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:41:58 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:owner>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:user uuid="52c5144f378a4912b225fff6bf91ffe5">tempest-VolumesNegativeTest-1539683747-project-member</nova:user>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:project uuid="1623cf95d2344ee6855e7e283edeacf8">tempest-VolumesNegativeTest-1539683747</nova:project>
Nov 29 07:41:58 user nova-compute[75373]:       </nova:owner>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:41:58 user nova-compute[75373]:       <nova:ports>
Nov 29 07:41:58 user nova-compute[75373]:         <nova:port uuid="79929b03-efa4-401c-9a9c-a77e34ff68b9">
Nov 29 07:41:58 user nova-compute[75373]:           <nova:ip type="fixed" address="192.168.233.252" ipVersion="4"/>
Nov 29 07:41:58 user nova-compute[75373]:         </nova:port>
Nov 29 07:41:58 user nova-compute[75373]:       </nova:ports>
Nov 29 07:41:58 user nova-compute[75373]:     </nova:instance>
Nov 29 07:41:58 user nova-compute[75373]:   </metadata>
Nov 29 07:41:58 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:41:58 user nova-compute[75373]:     <system>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="serial">e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80</entry>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="uuid">e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80</entry>
Nov 29 07:41:58 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:41:58 user nova-compute[75373]:     </system>
Nov 29 07:41:58 user nova-compute[75373]:   </sysinfo>
Nov 29 07:41:58 user nova-compute[75373]:   <os>
Nov 29 07:41:58 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:41:58 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:41:58 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:41:58 user nova-compute[75373]:   </os>
Nov 29 07:41:58 user nova-compute[75373]:   <features>
Nov 29 07:41:58 user nova-compute[75373]:     <acpi/>
Nov 29 07:41:58 user nova-compute[75373]:     <apic/>
Nov 29 07:41:58 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:41:58 user nova-compute[75373]:   </features>
Nov 29 07:41:58 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:41:58 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:41:58 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:41:58 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:41:58 user nova-compute[75373]:   </clock>
Nov 29 07:41:58 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:41:58 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:41:58 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:41:58 user nova-compute[75373]:   </cpu>
Nov 29 07:41:58 user nova-compute[75373]:   <devices>
Nov 29 07:41:58 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:41:58 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:41:58 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk"/>
Nov 29 07:41:58 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:41:58 user nova-compute[75373]:     </disk>
Nov 29 07:41:58 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:41:58 user nova-compute[75373]:       <mac address="fa:16:3e:63:66:a0"/>
Nov 29 07:41:58 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:41:58 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:41:58 user nova-compute[75373]:       <target dev="tap79929b03-ef"/>
Nov 29 07:41:58 user nova-compute[75373]:     </interface>
Nov 29 07:41:58 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:41:58 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/console.log" append="off"/>
Nov 29 07:41:58 user nova-compute[75373]:     </serial>
Nov 29 07:41:58 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:41:58 user nova-compute[75373]:     <video>
Nov 29 07:41:58 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:41:58 user nova-compute[75373]:     </video>
Nov 29 07:41:58 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:41:58 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:41:58 user nova-compute[75373]:     </rng>
Nov 29 07:41:58 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:41:58 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:41:58 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:41:58 user nova-compute[75373]:     </memballoon>
Nov 29 07:41:58 user nova-compute[75373]:   </devices>
Nov 29 07:41:58 user nova-compute[75373]: </domain>
Nov 29 07:41:58 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1986969278',display_name='tempest-VolumesNegativeTest-instance-1986969278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1986969278',id=39,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1623cf95d2344ee6855e7e283edeacf8',ramdisk_id='',reservation_id='r-1qkqtryl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1539683747',owner_user_name='tempest-VolumesNegativeTest-1539683747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:41:56Z,user_data=None,user_id='52c5144f378a4912b225fff6bf91ffe5',uuid=e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converting VIF {"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG os_vif [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf4eee1d-76aa-5816-8fa0-654947103620', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79929b03-ef, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79929b03-ef, col_values=(('qos', UUID('4eaa37d2-4184-42b9-8e3f-e7a22e6d53b9')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79929b03-ef, col_values=(('external_ids', {'iface-id': '79929b03-efa4-401c-9a9c-a77e34ff68b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:66:a0', 'vm-uuid': 'e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:58 user nova-compute[75373]: INFO os_vif [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef')
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:41:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] No VIF found with MAC fa:16:3e:63:66:a0, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: INFO nova.compute.manager [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Terminating instance
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Updated VIF entry in instance network info cache for port 79929b03-efa4-401c-9a9c-a77e34ff68b9. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Updating instance_info_cache with network_info: [{"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9f2bfa14-6910-42a9-884a-9a3a9b8bdc24 req-4afb7e61-a750-4896-bc8c-2b279f346c4d service nova] Releasing lock "refresh_cache-e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:41:59 user nova-compute[75373]: WARNING nova.compute.manager [req-963ff3ab-8ce0-4407-88fc-64472792e37f req-54a9636f-51e7-4370-981c-fbf35449783a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state active and task_state rescuing.
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG nova.compute.manager [req-c124704f-2c1d-45ad-ba4b-63e3d68c51be req-8c6a026b-00f2-4217-9625-bdd2c4c6e847 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-unplugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:41:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Instance destroyed successfully.
Nov 29 07:42:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid f711ec64-cda6-4ee9-bc54-32b2b34d2acd {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:36:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1365733974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1365733974',id=36,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:38:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-q2ydo015',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:40:13Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=f711ec64-cda6-4ee9-bc54-32b2b34d2acd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "673cb70d-ed66-49b5-8d03-074b629d1f33", "address": "fa:16:3e:f6:66:15", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap673cb70d-ed", "ovs_interfaceid": "673cb70d-ed66-49b5-8d03-074b629d1f33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_vif [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap673cb70d-ed, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ae2cbbc-7e33-4faa-9cdd-e457859eeb94) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:00 user nova-compute[75373]: INFO nova.compute.manager [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Shelve offloading
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: INFO os_vif [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:66:15,bridge_name='br-int',has_traffic_filtering=True,id=673cb70d-ed66-49b5-8d03-074b629d1f33,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap673cb70d-ed')
Nov 29 07:42:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BmYCvwjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:42:00 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5614830c-8186-43a4-b565-1e9e40316da1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:42:00 user nova-compute[75373]: No targets found.
Nov 29 07:42:00 user nova-compute[75373]: iSNS:
Nov 29 07:42:00 user nova-compute[75373]: No targets found.
Nov 29 07:42:00 user nova-compute[75373]: STATIC:
Nov 29 07:42:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:42:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83
Nov 29 07:42:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2
Nov 29 07:42:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:42:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:00 user nova-compute[75373]: FIRMWARE:
Nov 29 07:42:00 user nova-compute[75373]: No targets found.
Nov 29 07:42:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:42:00 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:42:00 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5f792-6741-4195-820d-7960c982e61b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd4d3e-3336-4af1-ac3c-026457ca7def]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:00 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae031c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db72df2-b15d-4b93-b7e7-21e457e84da2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad7338-b294-44f2-802a-e8bce94f66d3]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe07f32-3a24-494b-92a9-b523be539db2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.076s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2986e92-4dd8-4dfe-99a2-4c94e6538d5b]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance destroyed successfully.
Nov 29 07:42:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae22da-2d45-49c7-8d0a-9f5d1cb9628f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attempting a stable device rescue
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75373) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a12e8-e750-43a7-89bc-1b580ea0ed3b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260]
Nov 29 07:42:01 user nova-compute[75373]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83, portal: 172.16.0.220,3260] successful.
Nov 29 07:42:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance directory exists: not creating {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Creating image(s)
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'trusted_certs' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "4174b4e77be6b7384d849ae23da9062962e9cb66" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "4174b4e77be6b7384d849ae23da9062962e9cb66" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fe1f7-43f4-4a8d-8b31-bf1e01413d83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce8f7e-b593-4779-aa6d-eb6a845d5a42]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== disconnect_volume: return (424ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Deleting instance files /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd_del
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Deletion of /opt/stack/data/nova/instances/f711ec64-cda6-4ee9-bc54-32b2b34d2acd_del complete
Nov 29 07:42:01 user nova-compute[75373]: INFO nova.compute.manager [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Took 2.26 seconds to destroy the instance on the hypervisor.
Nov 29 07:42:01 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:42:01 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:02 user nova-compute[75373]: WARNING nova.compute.manager [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state active and task_state rescuing.
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing instance network info cache due to event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Acquiring lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] No waiting events found dispatching network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:02 user nova-compute[75373]: WARNING nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received unexpected event network-vif-plugged-673cb70d-ed66-49b5-8d03-074b629d1f33 for instance with vm_state active and task_state deleting.
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:02 user nova-compute[75373]: WARNING nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state active and task_state shelving.
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:02 user nova-compute[75373]: WARNING nova.compute.manager [req-5e865c76-78ab-4ea4-a5e0-51f09f312edc req-a2b61665-69e9-440a-a9e4-019f5c01e656 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state active and task_state shelving.
Nov 29 07:42:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance destroyed successfully.
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.virt.images [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] 6d8a96f1-829b-4a34-b7fc-eb7e6316942c was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:42:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.part /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-da5201af-a031-4758-a046-57a78735b0e9 req-96af5ab7-1504-42ae-99a6-c54ab86c04c0 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Received event network-vif-deleted-673cb70d-ed66-49b5-8d03-074b629d1f33 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:03 user nova-compute[75373]: INFO nova.compute.manager [req-da5201af-a031-4758-a046-57a78735b0e9 req-96af5ab7-1504-42ae-99a6-c54ab86c04c0 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Neutron deleted interface 673cb70d-ed66-49b5-8d03-074b629d1f33; detaching it from the instance and deleting it from the info cache
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-da5201af-a031-4758-a046-57a78735b0e9 req-96af5ab7-1504-42ae-99a6-c54ab86c04c0 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updated VIF entry in instance network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:03 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Took 2.07 seconds to deallocate network for instance.
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-da5201af-a031-4758-a046-57a78735b0e9 req-96af5ab7-1504-42ae-99a6-c54ab86c04c0 service nova] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Detach interface failed, port_id=673cb70d-ed66-49b5-8d03-074b629d1f33, reason: Instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7d4e0a09-c203-499e-820c-2ac1e27f5656 req-3b887860-8804-43f7-a7d7-9aa11b7c9165 service nova] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.network.neutron [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.part /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.converted" returned: 0 in 0.911s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] No waiting events found dispatching network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:03 user nova-compute[75373]: WARNING nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received unexpected event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 for instance with vm_state building and task_state spawning.
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] No waiting events found dispatching network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:03 user nova-compute[75373]: WARNING nova.compute.manager [req-6d928953-05f4-4f4a-b2ae-0c1ddacd9764 req-19870df8-75b2-487e-a780-7ea02eccbd92 service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received unexpected event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 for instance with vm_state building and task_state spawning.
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "4174b4e77be6b7384d849ae23da9062962e9cb66" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.645s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "4174b4e77be6b7384d849ae23da9062962e9cb66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "4174b4e77be6b7384d849ae23da9062962e9cb66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66 --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66,backing_fmt=raw /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66,backing_fmt=raw /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue" returned: 0 in 0.053s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "4174b4e77be6b7384d849ae23da9062962e9cb66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'migration_context' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Object Instance<b819f808-d0cf-4db5-89d6-5b3a2dfec6a5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start _get_guest_xml network_info=[{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "vif_mac": "fa:16:3e:92:40:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6d8a96f1-829b-4a34-b7fc-eb7e6316942c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b819f808-d0cf-4db5-89d6-5b3a2dfec6a5', 'attached_at': '', 'detached_at': '', 'volume_id': '27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'serial': '27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '25078a71-db5e-490b-92b4-28777af4b637', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'resources' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Object Instance<b819f808-d0cf-4db5-89d6-5b3a2dfec6a5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'numa_topology' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Object Instance<b819f808-d0cf-4db5-89d6-5b3a2dfec6a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:04 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:04 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'vcpu_model' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Object Instance<b819f808-d0cf-4db5-89d6-5b3a2dfec6a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:42:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:42:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:42:04 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.compute.manager [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: f711ec64-cda6-4ee9-bc54-32b2b34d2acd] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Instance spawned successfully.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4302b482-a251-4026-8691-31f48d2e2217]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rLGXNoIP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 07:42:04 user nova-compute[75373]: node.name = iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:42:04 user nova-compute[75373]: node.tpgt = -1
Nov 29 07:42:04 user nova-compute[75373]: node.startup = automatic
Nov 29 07:42:04 user nova-compute[75373]: node.leading_login = No
Nov 29 07:42:04 user nova-compute[75373]: iface.iscsi_ifacename = default
Nov 29 07:42:04 user nova-compute[75373]: iface.net_ifacename = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.ipaddress = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.prefix_len = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.hwaddress = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.transport_name = tcp
Nov 29 07:42:04 user nova-compute[75373]: iface.initiatorname = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.vlan_id = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.vlan_priority = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.vlan_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.iface_num = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.mtu = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.port = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.bootproto = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.subnet_mask = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.gateway = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_alt_client_id = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_dns = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_learn_iqn = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_vendor_id_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_vendor_id = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.dhcp_slp_da = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.fragmentation = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.gratuitous_arp = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.incoming_forwarding = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.tos_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.tos = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.ttl = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.delayed_ack = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.tcp_nagle = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.tcp_wsf_state = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.tcp_wsf = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.tcp_timer_scale = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.tcp_timestamp = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.redirect = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.def_task_mgmt_timeout = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.header_digest = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.data_digest = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.immediate_data = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.initial_r2t = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.data_seq_inorder = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.data_pdu_inorder = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.erl = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.max_receive_data_len = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.first_burst_len = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.max_outstanding_r2t = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.max_burst_len = 0
Nov 29 07:42:04 user nova-compute[75373]: iface.chap_auth = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.bidi_chap = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.strict_login_compliance = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.discovery_auth = <empty>
Nov 29 07:42:04 user nova-compute[75373]: iface.discovery_logout = <empty>
Nov 29 07:42:04 user nova-compute[75373]: node.discovery_address = <empty>
Nov 29 07:42:04 user nova-compute[75373]: node.discovery_port = 0
Nov 29 07:42:04 user nova-compute[75373]: node.discovery_type = static
Nov 29 07:42:04 user nova-compute[75373]: node.session.initial_cmdsn = 0
Nov 29 07:42:04 user nova-compute[75373]: node.session.initial_login_retry_max = 8
Nov 29 07:42:04 user nova-compute[75373]: node.session.xmit_thread_priority = -20
Nov 29 07:42:04 user nova-compute[75373]: node.session.cmds_max = 128
Nov 29 07:42:04 user nova-compute[75373]: node.session.queue_depth = 32
Nov 29 07:42:04 user nova-compute[75373]: node.session.nr_sessions = 1
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.authmethod = CHAP
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.username = rLGXNoIP
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.password = ***
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.username_in = <empty>
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.password_in = <empty>
Nov 29 07:42:04 user nova-compute[75373]: node.session.auth.chap_algs = MD5
Nov 29 07:42:04 user nova-compute[75373]: node.session.timeo.replacement_timeout = 120
Nov 29 07:42:04 user nova-compute[75373]: node.session.err_timeo.abort_timeout = 15
Nov 29 07:42:04 user nova-compute[75373]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 07:42:04 user nova-compute[75373]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 07:42:04 user nova-compute[75373]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.FastAbort = Yes
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.InitialR2T = No
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.ImmediateData = Yes
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.MaxConnections = 1
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 07:42:04 user nova-compute[75373]: node.session.iscsi.ERL = 0
Nov 29 07:42:04 user nova-compute[75373]: node.session.scan = manual
Nov 29 07:42:04 user nova-compute[75373]: node.session.reopen_max = 0
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].address = 172.16.0.220
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].port = 3260
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].startup = manual
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].tcp.window_size = 524288
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].tcp.type_of_service = 0
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].timeo.logout_timeout = 15
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].timeo.login_timeout = 15
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].timeo.auth_timeout = 45
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.DataDigest = None
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.IFMarker = No
Nov 29 07:42:04 user nova-compute[75373]: node.conn[0].iscsi.OFMarker = No
Nov 29 07:42:04 user nova-compute[75373]: # END RECORD
Nov 29 07:42:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac86860-3ff8-4c6d-971b-ef2c8fa667d4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5462c09e-8379-4844-945b-b47235aef07e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLGXNoIP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLGXNoIP" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16af4cf-f9eb-456f-bfdf-927f375bd400]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLGXNoIP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[81065317-fdb6-4e47-9ccf-f29078f92635]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Took 8.44 seconds to spawn the instance on the hypervisor.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4763abd7-63ef-428c-b9e6-8a141f982b91]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:04 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:04 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:04 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:04 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] HCTL ('36', '0', '0', 0) found on session 42 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b4d25-c44e-4b85-9bd3-a988c428c306]: (4, ('0 0 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Searching for a device in session 42 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.201s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '23063316161666438', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063316161666438', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1386571198',display_name='tempest-ServerStableDeviceRescueTest-server-1386571198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1386571198',id=37,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3gBi1mV/8pxaPbDcJaalYHnRU4Ag2AHamBhfWTe1ESUYqIjvCef5yCJfsldoX+hbSJttpQF2UFgwwJhUl/izFDQQE991o1JqeFoRM8ZNAXaN4koHXvjAOix/ChKdnIbg==',key_name='tempest-keypair-302191484',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:38:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db2b708cb1df4d2ea2536831e3d83206',ramdisk_id='',reservation_id='r-8j44pxcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-977224491',owner_user_name='tempest-ServerStableDeviceRescueTest-977224491-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='809d6d574ea2441a9a2c24be9c409139',uuid=b819f808-d0cf-4db5-89d6-5b3a2dfec6a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "vif_mac": "fa:16:3e:92:40:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converting VIF {"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "vif_mac": "fa:16:3e:92:40:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'pci_devices' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.base [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Object Instance<b819f808-d0cf-4db5-89d6-5b3a2dfec6a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:42:04 user nova-compute[75373]:   <uuid>b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</uuid>
Nov 29 07:42:04 user nova-compute[75373]:   <name>instance-00000025</name>
Nov 29 07:42:04 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:42:04 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:42:04 user nova-compute[75373]:   <metadata>
Nov 29 07:42:04 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:42:04 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1386571198</nova:name>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:42:04</nova:creationTime>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:42:04 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:42:04 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:owner>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:user uuid="809d6d574ea2441a9a2c24be9c409139">tempest-ServerStableDeviceRescueTest-977224491-project-member</nova:user>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:project uuid="db2b708cb1df4d2ea2536831e3d83206">tempest-ServerStableDeviceRescueTest-977224491</nova:project>
Nov 29 07:42:04 user nova-compute[75373]:       </nova:owner>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:42:04 user nova-compute[75373]:       <nova:ports>
Nov 29 07:42:04 user nova-compute[75373]:         <nova:port uuid="c2fbaa44-3b2e-4473-b109-19a8e355ed59">
Nov 29 07:42:04 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:42:04 user nova-compute[75373]:         </nova:port>
Nov 29 07:42:04 user nova-compute[75373]:       </nova:ports>
Nov 29 07:42:04 user nova-compute[75373]:     </nova:instance>
Nov 29 07:42:04 user nova-compute[75373]:   </metadata>
Nov 29 07:42:04 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:42:04 user nova-compute[75373]:     <system>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="serial">b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</entry>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="uuid">b819f808-d0cf-4db5-89d6-5b3a2dfec6a5</entry>
Nov 29 07:42:04 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:42:04 user nova-compute[75373]:     </system>
Nov 29 07:42:04 user nova-compute[75373]:   </sysinfo>
Nov 29 07:42:04 user nova-compute[75373]:   <os>
Nov 29 07:42:04 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:42:04 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:42:04 user nova-compute[75373]:   </os>
Nov 29 07:42:04 user nova-compute[75373]:   <features>
Nov 29 07:42:04 user nova-compute[75373]:     <acpi/>
Nov 29 07:42:04 user nova-compute[75373]:     <apic/>
Nov 29 07:42:04 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:42:04 user nova-compute[75373]:   </features>
Nov 29 07:42:04 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:42:04 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:42:04 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:42:04 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:42:04 user nova-compute[75373]:   </clock>
Nov 29 07:42:04 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:42:04 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:42:04 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:42:04 user nova-compute[75373]:   </cpu>
Nov 29 07:42:04 user nova-compute[75373]:   <devices>
Nov 29 07:42:04 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:42:04 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:42:04 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk"/>
Nov 29 07:42:04 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:42:04 user nova-compute[75373]:     </disk>
Nov 29 07:42:04 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:42:04 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:42:04 user nova-compute[75373]:       <source dev="/dev/sde"/>
Nov 29 07:42:04 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:42:04 user nova-compute[75373]:       <serial>27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e</serial>
Nov 29 07:42:04 user nova-compute[75373]:     </disk>
Nov 29 07:42:04 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:42:04 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:42:04 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue"/>
Nov 29 07:42:04 user nova-compute[75373]:       <target dev="vdc" bus="virtio"/>
Nov 29 07:42:04 user nova-compute[75373]:       <boot order="1"/>
Nov 29 07:42:04 user nova-compute[75373]:     </disk>
Nov 29 07:42:04 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:42:04 user nova-compute[75373]:       <mac address="fa:16:3e:92:40:cd"/>
Nov 29 07:42:04 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:42:04 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:42:04 user nova-compute[75373]:       <target dev="tapc2fbaa44-3b"/>
Nov 29 07:42:04 user nova-compute[75373]:     </interface>
Nov 29 07:42:04 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:42:04 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/console.log" append="off"/>
Nov 29 07:42:04 user nova-compute[75373]:     </serial>
Nov 29 07:42:04 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:42:04 user nova-compute[75373]:     <video>
Nov 29 07:42:04 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:42:04 user nova-compute[75373]:     </video>
Nov 29 07:42:04 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:42:04 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:42:04 user nova-compute[75373]:     </rng>
Nov 29 07:42:04 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:42:04 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:42:04 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:42:04 user nova-compute[75373]:     </memballoon>
Nov 29 07:42:04 user nova-compute[75373]:   </devices>
Nov 29 07:42:04 user nova-compute[75373]: </domain>
Nov 29 07:42:04 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.compute.manager [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Took 9.77 seconds to build instance.
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance destroyed successfully.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-97310bc4-86c0-4531-bfdc-469b9b0763e7 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.890s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] No VIF found with MAC fa:16:3e:92:40:cd, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Deleted allocations for instance f711ec64-cda6-4ee9-bc54-32b2b34d2acd
Nov 29 07:42:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance destroyed successfully.
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'resources' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCePht6phlCj5AAAtGEeqWHlduphWnWp6IPt44audw7zKbVTtGgNmcQ4RsT3H6ZTD+2L7nN48T1uPfiFsgfjEiUHd3TPGATSqfy05hE7bYqmBvylKMJnCcmK1s/BJIYX3g==',key_name='tempest-TestShelveInstance-573824224',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:40:23Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_vif [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7980c5b-bb, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f132463-a4d7-446f-8043-ba518e1a0b92) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-67a8a6aa-d58b-4177-becd-bc8f2af02ea2 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "f711ec64-cda6-4ee9-bc54-32b2b34d2acd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.894s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:04 user nova-compute[75373]: INFO os_vif [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb')
Nov 29 07:42:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:42:04 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d6622-e5b5-4bc0-80cc-e097d395133d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:42:04 user nova-compute[75373]: No targets found.
Nov 29 07:42:04 user nova-compute[75373]: iSNS:
Nov 29 07:42:04 user nova-compute[75373]: No targets found.
Nov 29 07:42:04 user nova-compute[75373]: STATIC:
Nov 29 07:42:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:42:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2
Nov 29 07:42:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:04 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:42:04 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:42:04 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:42:04 user nova-compute[75373]: FIRMWARE:
Nov 29 07:42:04 user nova-compute[75373]: No targets found.
Nov 29 07:42:04 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:42:04 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:42:04 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[93568421-5806-4996-9402-89f76db38f1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5a042-07c7-4b35-b642-cab0b9a78e4e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:05 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:05 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:05 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:42:05 user nova-compute[75373]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:42:05 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:42:05 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b08933ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab8436-b151-4382-a329-0301c2cc5ff8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c767909-d205-4dda-8543-6ea67683e3fe]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a380206-77de-4e59-97d9-8d2de33558f4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc6f91-b8fa-4ddd-94f8-76b194566610]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e403527-213f-4393-8bf2-e159f1b7a088]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95c59f7-456d-406f-9f46-cc1f412d21e1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]
Nov 29 07:42:05 user nova-compute[75373]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.
Nov 29 07:42:05 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[42400e24-78ef-482a-8307-b910f989fbf6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== disconnect_volume: return (316ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:42:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deleting instance files /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9_del
Nov 29 07:42:05 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deletion of /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9_del complete
Nov 29 07:42:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing instance network info cache due to event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updated VIF entry in instance network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": null, "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape7980c5b-bb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:06 user nova-compute[75373]: WARNING nova.compute.manager [req-f5179a03-b345-4138-b91a-e7b4106e1fac req-39748ec9-8673-47c1-9d95-22db9ecb5801 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state active and task_state rescuing.
Nov 29 07:42:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc472bc9-eebc-4243-a1d6-34d42e859ada req-20278280-aea6-4ca3-9c3e-717f21392f97 service nova] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:06 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Deleted allocations for instance f66de8ab-d248-4064-a13a-8c7d9a81aff9
Nov 29 07:42:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'numa_topology' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG nova.objects.base [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Object Instance<f66de8ab-d248-4064-a13a-8c7d9a81aff9> lazy-loaded attributes: resources,numa_topology {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7ab5959f-20cc-4ce2-9d06-821507c21e7c tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.656s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:08 user nova-compute[75373]: WARNING nova.compute.manager [req-1689e1d5-dd83-4052-b98c-3de00a69a382 req-c0fdff85-7c5b-4023-82f3-98c72b1af676 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state active and task_state rescuing.
Nov 29 07:42:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2ba7817b-749b-4133-99db-b7aa057871e3 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:42:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:42:23 user nova-compute[75373]: INFO nova.compute.claims [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Claim successful on node user
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:42:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.policy [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e56dc3bced44898bd6abd5b6e135e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d981da33f04ed6a957a1df16fca63c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:42:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Creating image(s)
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "/opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "/opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:23 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.215s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Successfully created port: 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk 1073741824" returned: 0 in 0.055s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Cannot resize image /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Ensure instance console log exists: /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Successfully updated port: 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquired lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:24 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-changed-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Refreshing instance network info cache due to event network-changed-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] Acquiring lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.neutron [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating instance_info_cache with network_info: [{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Releasing lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Instance network_info: |[{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] Acquired lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Refreshing network info cache for port 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Start _get_guest_xml network_info=[{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:42:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210167',id=40,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb23Uhn+YtarXM0VZIYh6kKV+R2bLBaVQ+x4gpYTPqeJUMNH8G2wqczF1poSmbVED8itO4EvH2R7HPmiwodEo155rh9TtCs+VmVuFvKYoHo/K5lbCeU28HxPa5FxF1cmw==',key_name='tempest-keypair-1746303401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60d981da33f04ed6a957a1df16fca63c',ramdisk_id='',reservation_id='r-4v7wn0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e56dc3bced44898bd6abd5b6e135e2b',uuid=53f246fb-2511-4586-be4d-17413b4ac2a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converting VIF {"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:42:25 user nova-compute[75373]:   <uuid>53f246fb-2511-4586-be4d-17413b4ac2a8</uuid>
Nov 29 07:42:25 user nova-compute[75373]:   <name>instance-00000028</name>
Nov 29 07:42:25 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:42:25 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:42:25 user nova-compute[75373]:   <metadata>
Nov 29 07:42:25 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:42:25 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703</nova:name>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:42:25</nova:creationTime>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:42:25 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:42:25 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:owner>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:user uuid="0e56dc3bced44898bd6abd5b6e135e2b">tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member</nova:user>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:project uuid="60d981da33f04ed6a957a1df16fca63c">tempest-TestServerVolumeAttachScenarioOldVersion-810519940</nova:project>
Nov 29 07:42:25 user nova-compute[75373]:       </nova:owner>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:42:25 user nova-compute[75373]:       <nova:ports>
Nov 29 07:42:25 user nova-compute[75373]:         <nova:port uuid="29b47a29-ad9b-4e98-8a0a-e5f6bb62655e">
Nov 29 07:42:25 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:42:25 user nova-compute[75373]:         </nova:port>
Nov 29 07:42:25 user nova-compute[75373]:       </nova:ports>
Nov 29 07:42:25 user nova-compute[75373]:     </nova:instance>
Nov 29 07:42:25 user nova-compute[75373]:   </metadata>
Nov 29 07:42:25 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:42:25 user nova-compute[75373]:     <system>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="serial">53f246fb-2511-4586-be4d-17413b4ac2a8</entry>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="uuid">53f246fb-2511-4586-be4d-17413b4ac2a8</entry>
Nov 29 07:42:25 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:42:25 user nova-compute[75373]:     </system>
Nov 29 07:42:25 user nova-compute[75373]:   </sysinfo>
Nov 29 07:42:25 user nova-compute[75373]:   <os>
Nov 29 07:42:25 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:42:25 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:42:25 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:42:25 user nova-compute[75373]:   </os>
Nov 29 07:42:25 user nova-compute[75373]:   <features>
Nov 29 07:42:25 user nova-compute[75373]:     <acpi/>
Nov 29 07:42:25 user nova-compute[75373]:     <apic/>
Nov 29 07:42:25 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:42:25 user nova-compute[75373]:   </features>
Nov 29 07:42:25 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:42:25 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:42:25 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:42:25 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:42:25 user nova-compute[75373]:   </clock>
Nov 29 07:42:25 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:42:25 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:42:25 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:42:25 user nova-compute[75373]:   </cpu>
Nov 29 07:42:25 user nova-compute[75373]:   <devices>
Nov 29 07:42:25 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:42:25 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:42:25 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk"/>
Nov 29 07:42:25 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:42:25 user nova-compute[75373]:     </disk>
Nov 29 07:42:25 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:42:25 user nova-compute[75373]:       <mac address="fa:16:3e:64:0b:75"/>
Nov 29 07:42:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:42:25 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:42:25 user nova-compute[75373]:       <target dev="tap29b47a29-ad"/>
Nov 29 07:42:25 user nova-compute[75373]:     </interface>
Nov 29 07:42:25 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:42:25 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/console.log" append="off"/>
Nov 29 07:42:25 user nova-compute[75373]:     </serial>
Nov 29 07:42:25 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:42:25 user nova-compute[75373]:     <video>
Nov 29 07:42:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:42:25 user nova-compute[75373]:     </video>
Nov 29 07:42:25 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:42:25 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:42:25 user nova-compute[75373]:     </rng>
Nov 29 07:42:25 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:42:25 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:42:25 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:42:25 user nova-compute[75373]:     </memballoon>
Nov 29 07:42:25 user nova-compute[75373]:   </devices>
Nov 29 07:42:25 user nova-compute[75373]: </domain>
Nov 29 07:42:25 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210167',id=40,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb23Uhn+YtarXM0VZIYh6kKV+R2bLBaVQ+x4gpYTPqeJUMNH8G2wqczF1poSmbVED8itO4EvH2R7HPmiwodEo155rh9TtCs+VmVuFvKYoHo/K5lbCeU28HxPa5FxF1cmw==',key_name='tempest-keypair-1746303401',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60d981da33f04ed6a957a1df16fca63c',ramdisk_id='',reservation_id='r-4v7wn0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e56dc3bced44898bd6abd5b6e135e2b',uuid=53f246fb-2511-4586-be4d-17413b4ac2a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converting VIF {"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG os_vif [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09dee5f6-57b4-5a6d-ad68-2fdfec8575e6', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29b47a29-ad, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29b47a29-ad, col_values=(('qos', UUID('eb860167-18e2-4324-b023-5243b9316cfb')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29b47a29-ad, col_values=(('external_ids', {'iface-id': '29b47a29-ad9b-4e98-8a0a-e5f6bb62655e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:0b:75', 'vm-uuid': '53f246fb-2511-4586-be4d-17413b4ac2a8'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:25 user nova-compute[75373]: INFO os_vif [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad')
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] No VIF found with MAC fa:16:3e:64:0b:75, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updated VIF entry in instance network info cache for port 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating instance_info_cache with network_info: [{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8d468ce7-4bbb-4d96-b646-175b021bb95e req-ad98a14d-2dec-4bca-acd3-58a0fdb6d391 service nova] Releasing lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:27 user nova-compute[75373]: WARNING nova.compute.manager [req-a94c16cd-b3b7-47da-b824-63c6ef320ba8 req-ed4d0be7-e27f-4c9d-b673-e6ffecc6e5aa service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state building and task_state spawning.
Nov 29 07:42:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:42:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Instance spawned successfully.
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:42:28 user nova-compute[75373]: INFO nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 29 07:42:28 user nova-compute[75373]: DEBUG nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:42:29 user nova-compute[75373]: INFO nova.compute.manager [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Took 5.73 seconds to build instance.
Nov 29 07:42:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-bf4156d5-f570-4101-9514-515a21e2766e tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.851s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:29 user nova-compute[75373]: WARNING nova.compute.manager [req-12681b34-f5a8-41cb-ac25-e726bfdc54c3 req-4d6df8bf-925e-4c96-890b-7ea8400dc953 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state active and task_state None.
Nov 29 07:42:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:42:43 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid 7c25504f-ed6b-409c-8849-68c1ca27fe93 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [{"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-7c25504f-ed6b-409c-8849-68c1ca27fe93" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:42:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:42:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:49 user nova-compute[75373]: INFO nova.compute.manager [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Terminating instance
Nov 29 07:42:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-unplugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] No waiting events found dispatching network-vif-unplugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-bf4815ba-ba6d-4b6c-8a35-f02030e6bcd8 req-5cb5b5b6-eea1-49cd-8d43-ec6ec1677b46 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-unplugged-c91cc7eb-7190-43a8-986d-832534764c09 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Instance destroyed successfully.
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid 201b9ba5-fa23-4c43-8ca7-b55093c7b643 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:33:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377946000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377946000',id=32,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:33:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-ksimmmlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:35:23Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=201b9ba5-fa23-4c43-8ca7-b55093c7b643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "c91cc7eb-7190-43a8-986d-832534764c09", "address": "fa:16:3e:13:a1:d9", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc91cc7eb-71", "ovs_interfaceid": "c91cc7eb-7190-43a8-986d-832534764c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG os_vif [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc91cc7eb-71, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82e925a3-959f-4d25-929d-570373f70263) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:42:50 user nova-compute[75373]: INFO os_vif [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:d9,bridge_name='br-int',has_traffic_filtering=True,id=c91cc7eb-7190-43a8-986d-832534764c09,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc91cc7eb-71')
Nov 29 07:42:50 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Deleting instance files /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643_del
Nov 29 07:42:50 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Deletion of /opt/stack/data/nova/instances/201b9ba5-fa23-4c43-8ca7-b55093c7b643_del complete
Nov 29 07:42:50 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:50 user nova-compute[75373]: INFO nova.compute.manager [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 07:42:50 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:42:50 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:51 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Took 0.46 seconds to deallocate network for instance.
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-327585fa-e69e-4e80-ab20-4484b51a555f req-46b547ef-e73e-4114-a224-b7ce5b798948 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-deleted-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:51 user nova-compute[75373]: INFO nova.compute.manager [req-327585fa-e69e-4e80-ab20-4484b51a555f req-46b547ef-e73e-4114-a224-b7ce5b798948 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Neutron deleted interface c91cc7eb-7190-43a8-986d-832534764c09; detaching it from the instance and deleting it from the info cache
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.network.neutron [req-327585fa-e69e-4e80-ab20-4484b51a555f req-46b547ef-e73e-4114-a224-b7ce5b798948 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-327585fa-e69e-4e80-ab20-4484b51a555f req-46b547ef-e73e-4114-a224-b7ce5b798948 service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Detach interface failed, port_id=c91cc7eb-7190-43a8-986d-832534764c09, reason: Instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:51 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Deleted allocations for instance 201b9ba5-fa23-4c43-8ca7-b55093c7b643
Nov 29 07:42:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f86b5037-7021-4191-be97-cdef9b1508d7 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:42:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] Acquiring lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] Lock "201b9ba5-fa23-4c43-8ca7-b55093c7b643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] No waiting events found dispatching network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:42:52 user nova-compute[75373]: WARNING nova.compute.manager [req-da37f264-e198-4724-8a4e-48b18fafa4ef req-b7140859-1265-457d-9317-7ad57c7daccf service nova] [instance: 201b9ba5-fa23-4c43-8ca7-b55093c7b643] Received unexpected event network-vif-plugged-c91cc7eb-7190-43a8-986d-832534764c09 for instance with vm_state deleted and task_state None.
Nov 29 07:42:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:42:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:55 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:42:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:42:57 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:57 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=24.870216369628906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 5de96a96-0082-43fa-a18d-be40468c6c8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 53f246fb-2511-4586-be4d-17413b4ac2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:42:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:42:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:42:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:43:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:40 user nova-compute[75373]: INFO nova.compute.manager [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Terminating instance
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-d3e3d171-bb97-4461-907e-494e5e825660 req-607dbf5a-8e33-4261-b9e9-de68aa4c3e09 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-unplugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Instance destroyed successfully.
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid 5de96a96-0082-43fa-a18d-be40468c6c8d {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1623388813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1623388813',id=21,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:29:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-8hirr1iu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:31:39Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=5de96a96-0082-43fa-a18d-be40468c6c8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "address": "fa:16:3e:9e:33:3a", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1308faaa-a0", "ovs_interfaceid": "1308faaa-a0a4-43fe-9a15-d8ba09ad85bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_vif [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1308faaa-a0, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3d3ebba-2346-4229-8bf8-2b824f5a72eb) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:40 user nova-compute[75373]: INFO os_vif [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:33:3a,bridge_name='br-int',has_traffic_filtering=True,id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1308faaa-a0')
Nov 29 07:43:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XAeajImZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:43:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f18746-f14c-40de-883b-96b85215150c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:43:40 user nova-compute[75373]: No targets found.
Nov 29 07:43:40 user nova-compute[75373]: iSNS:
Nov 29 07:43:40 user nova-compute[75373]: No targets found.
Nov 29 07:43:40 user nova-compute[75373]: STATIC:
Nov 29 07:43:40 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:43:40 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:43:40 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:43:40 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43
Nov 29 07:43:40 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:43:40 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:43:40 user nova-compute[75373]: FIRMWARE:
Nov 29 07:43:40 user nova-compute[75373]: No targets found.
Nov 29 07:43:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:43:40 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:43:40 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe417db-d6ae-42a0-8ddb-7ad34b5def61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3605e9c-60fb-412b-a7ff-484184ef31aa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:43:40 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:43:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 (non-flash)
Nov 29 07:43:40 user nova-compute[75373]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:43:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0449630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43'): ({'sdd'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Removing single pathed devices sdd {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b549531-e399-4d96-b280-0a29a2c6e912]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7587bcaf-322a-4be7-85ab-7ce5a40cafc7]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Flushing IO for device /dev/sdd {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d62d55b-d220-4a7e-bdac-842c2b3e592c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02d514-7f80-48f4-97af-45bbf3ed6319]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c299a52-c188-45e3-aa51-71ea608b0642]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd6fdf0-4171-4771-9f58-c7b873811c5f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260]
Nov 29 07:43:41 user nova-compute[75373]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43, portal: 172.16.0.220,3260] successful.
Nov 29 07:43:41 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e082533d-6115-4edc-844b-b6a8a167cc43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3038f0b4-de3d-441d-ae19-0d18226c0645]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] <== disconnect_volume: return (302ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:43:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Deleting instance files /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d_del
Nov 29 07:43:41 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Deletion of /opt/stack/data/nova/instances/5de96a96-0082-43fa-a18d-be40468c6c8d_del complete
Nov 29 07:43:41 user nova-compute[75373]: INFO nova.compute.manager [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 07:43:41 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:41 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Took 0.38 seconds to deallocate network for instance.
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-e74dc5fa-a5dc-4af3-868e-e84f06de16a6 req-a46b6298-0fb1-492f-bbd4-6e3adb498d9b service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-deleted-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:41 user nova-compute[75373]: INFO nova.compute.manager [req-e74dc5fa-a5dc-4af3-868e-e84f06de16a6 req-a46b6298-0fb1-492f-bbd4-6e3adb498d9b service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Neutron deleted interface 1308faaa-a0a4-43fe-9a15-d8ba09ad85bd; detaching it from the instance and deleting it from the info cache
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.network.neutron [req-e74dc5fa-a5dc-4af3-868e-e84f06de16a6 req-a46b6298-0fb1-492f-bbd4-6e3adb498d9b service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:41 user nova-compute[75373]: DEBUG nova.compute.manager [req-e74dc5fa-a5dc-4af3-868e-e84f06de16a6 req-a46b6298-0fb1-492f-bbd4-6e3adb498d9b service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Detach interface failed, port_id=1308faaa-a0a4-43fe-9a15-d8ba09ad85bd, reason: Instance 5de96a96-0082-43fa-a18d-be40468c6c8d could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:43:42 user nova-compute[75373]: INFO nova.compute.manager [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] Acquiring lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] No waiting events found dispatching network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:42 user nova-compute[75373]: WARNING nova.compute.manager [req-2ae61de5-d74b-41b4-9f1d-b2a1a4208b9b req-11c938d2-46f0-4895-94fc-9ff30f52a458 service nova] [instance: 5de96a96-0082-43fa-a18d-be40468c6c8d] Received unexpected event network-vif-plugged-1308faaa-a0a4-43fe-9a15-d8ba09ad85bd for instance with vm_state deleted and task_state None.
Nov 29 07:43:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:42 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Deleted allocations for instance 5de96a96-0082-43fa-a18d-be40468c6c8d
Nov 29 07:43:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a497695a-4423-44ff-a76a-a0e05557ca85 tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "5de96a96-0082-43fa-a18d-be40468c6c8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.447s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:43 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:43:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:43:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:43:43 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:44 user nova-compute[75373]: INFO nova.compute.manager [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Terminating instance
Nov 29 07:43:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-unplugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] No waiting events found dispatching network-vif-unplugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-c0b394ee-e9de-4749-b976-85adf6cbb32a req-eeb90431-9c54-4369-8309-cbca77ba030d service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-unplugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:43:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Instance destroyed successfully.
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lazy-loading 'resources' on Instance uuid e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1986969278',display_name='tempest-VolumesNegativeTest-instance-1986969278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1986969278',id=39,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:42:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1623cf95d2344ee6855e7e283edeacf8',ramdisk_id='',reservation_id='r-1qkqtryl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1539683747',owner_user_name='tempest-VolumesNegativeTest-1539683747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:42:04Z,user_data=None,user_id='52c5144f378a4912b225fff6bf91ffe5',uuid=e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converting VIF {"id": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "address": "fa:16:3e:63:66:a0", "network": {"id": "4b775284-1c37-496c-8261-5b95aec0aace", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d532832723cc4fbf8d2f03455186491c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79929b03-ef", "ovs_interfaceid": "79929b03-efa4-401c-9a9c-a77e34ff68b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG os_vif [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79929b03-ef, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4eaa37d2-4184-42b9-8e3f-e7a22e6d53b9) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:43:45 user nova-compute[75373]: INFO os_vif [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=79929b03-efa4-401c-9a9c-a77e34ff68b9,network=Network(4b775284-1c37-496c-8261-5b95aec0aace),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79929b03-ef')
Nov 29 07:43:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Deleting instance files /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80_del
Nov 29 07:43:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Deletion of /opt/stack/data/nova/instances/e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80_del complete
Nov 29 07:43:45 user nova-compute[75373]: INFO nova.compute.manager [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 07:43:45 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:43:45 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:46 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Took 0.42 seconds to deallocate network for instance.
Nov 29 07:43:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:43:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:43:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:46 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Deleted allocations for instance e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80
Nov 29 07:43:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3635e801-f5ed-4e12-971b-4f21bc7edba5 tempest-VolumesNegativeTest-1539683747 tempest-VolumesNegativeTest-1539683747-project-member] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.671s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:47 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] Acquiring lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] Lock "e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:47 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] No waiting events found dispatching network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:47 user nova-compute[75373]: WARNING nova.compute.manager [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received unexpected event network-vif-plugged-79929b03-efa4-401c-9a9c-a77e34ff68b9 for instance with vm_state deleted and task_state None.
Nov 29 07:43:47 user nova-compute[75373]: DEBUG nova.compute.manager [req-f4dac7a1-f724-4333-adbd-424b2354e530 req-9eedb15e-2ef2-4e52-898a-a880e57ffe7a service nova] [instance: e9156dc3-0ca1-4d0b-b3eb-6a033ba97e80] Received event network-vif-deleted-79929b03-efa4-401c-9a9c-a77e34ff68b9 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:49 user nova-compute[75373]: INFO nova.compute.manager [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Unrescuing
Nov 29 07:43:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'flavor' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:50 user nova-compute[75373]: WARNING nova.compute.manager [req-84ccf1ac-6952-4799-a428-cdcf5540dc12 req-aa2425a8-5ae7-4610-a053-3dd090068a5e service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:43:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:50 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance destroyed successfully.
Nov 29 07:43:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing instance network info cache due to event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:52 user nova-compute[75373]: INFO nova.compute.manager [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Unshelving
Nov 29 07:43:52 user nova-compute[75373]: INFO nova.virt.block_device [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Booting with volume 79e139fa-917d-47a7-8f29-e7dc84ecbfe2 at /dev/vda
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.utils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec2087-54af-4e63-ac49-dbef0f4dd4e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114c12e-0d30-47a5-ab91-9c0147402015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d326583-890d-484c-953c-c23a6ed517f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a30cac-d9d4-4504-9631-efef03cebd39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updated VIF entry in instance network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing instance network info cache due to event network-changed-c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquiring lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquired lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Refreshing network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:43:52 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a4ad5-c028-4301-882f-6e4a4cd48c8a]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG os_brick.utils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating existing volume attachment record: 68530536-72d3-4aea-a6d5-c96199fb5682 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updated VIF entry in instance network info cache for port c2fbaa44-3b2e-4473-b109-19a8e355ed59. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.network.neutron [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [{"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Releasing lock "refresh_cache-b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:53 user nova-compute[75373]: WARNING nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:53 user nova-compute[75373]: WARNING nova.compute.manager [req-39d003c1-4b58-466f-aba8-7710dcd6ab8a req-bc6b6d94-6d49-4610-b2e8-1afce47f1167 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state rescued and task_state unrescuing.
Nov 29 07:43:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a6d8fde0-4399-4ebe-b333-fc8fc86f8f79 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:43:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:43:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:54 user nova-compute[75373]: DEBUG nova.compute.manager [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:43:54 user nova-compute[75373]: WARNING nova.compute.manager [req-b1b43949-eb02-474d-bc1d-e4c38d0e6201 req-409944c5-cf2e-4c11-b5c3-525f9782bba3 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state active and task_state None.
Nov 29 07:43:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:55 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:43:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:43:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:43:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:43:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=24.89742660522461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 53f246fb-2511-4586-be4d-17413b4ac2a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f66de8ab-d248-4064-a13a-8c7d9a81aff9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:43:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'pci_requests' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'numa_topology' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:44:00 user nova-compute[75373]: INFO nova.compute.claims [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Claim successful on node user
Nov 29 07:44:00 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:00 user nova-compute[75373]: INFO nova.network.neutron [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing instance network info cache due to event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:44:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Creating image(s)
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Ensure instance console log exists: /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start _get_guest_xml network_info=[{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f66de8ab-d248-4064-a13a-8c7d9a81aff9', 'attached_at': '', 'detached_at': '', 'volume_id': '79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'serial': '79e139fa-917d-47a7-8f29-e7dc84ecbfe2'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '68530536-72d3-4aea-a6d5-c96199fb5682', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:44:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:44:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'vcpu_model' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.objects.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Object Instance<f66de8ab-d248-4064-a13a-8c7d9a81aff9> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:44:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:01 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608422f-e097-476a-9be6-a2f9d34982f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:44:01 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d025488a-b5bf-42d2-b293-37fb7fde5f6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2] added
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73f9acd-23eb-43b4-a2c5-3d55b0a16927]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[573db317-d7f6-4ee1-8a38-59e44c36af7f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfbkuSRq {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfbkuSRq" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1708c7-974c-441d-a6cd-6f19385090fc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfbkuSRq'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48628f-3719-4842-8de4-bde422a60703]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03be84fc-88a5-4c7e-8105-3e343d08df88]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac2d91-e08c-4563-9d3e-7868577a3205]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]
Nov 29 07:44:01 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f112b33e-f2d5-49dd-a2f2-9a90ee239a4e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267dc72-477d-47b0-be23-49cef2ccaa1f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:01 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:01 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a547a-a138-44fa-bc21-10988a23dd27]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updated VIF entry in instance network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7fc97e4e-0fde-4683-a6ef-44be9bdeb0d9 req-c45a530b-23f9-4acd-af7c-8857d9dc02ad service nova] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23065633339356539', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633339356539', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-573824224',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:43:52Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'pci_devices' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.objects.base [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Object Instance<f66de8ab-d248-4064-a13a-8c7d9a81aff9> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:44:02 user nova-compute[75373]:   <uuid>f66de8ab-d248-4064-a13a-8c7d9a81aff9</uuid>
Nov 29 07:44:02 user nova-compute[75373]:   <name>instance-00000026</name>
Nov 29 07:44:02 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:44:02 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:44:02 user nova-compute[75373]:   <metadata>
Nov 29 07:44:02 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:44:02 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:44:02 user nova-compute[75373]:       <nova:name>tempest-TestShelveInstance-server-1814460307</nova:name>
Nov 29 07:44:02 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:44:01</nova:creationTime>
Nov 29 07:44:02 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:44:02 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:44:02 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:44:02 user nova-compute[75373]:       <nova:owner>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:user uuid="6f1e0b9fc9c74de2b0fc76b85ad16af0">tempest-TestShelveInstance-885872690-project-member</nova:user>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:project uuid="d47faf322a2e4f75bb17ff43013a863e">tempest-TestShelveInstance-885872690</nova:project>
Nov 29 07:44:02 user nova-compute[75373]:       </nova:owner>
Nov 29 07:44:02 user nova-compute[75373]:       <nova:ports>
Nov 29 07:44:02 user nova-compute[75373]:         <nova:port uuid="e7980c5b-bb5d-42b0-baa4-36c5f9863c9e">
Nov 29 07:44:02 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 07:44:02 user nova-compute[75373]:         </nova:port>
Nov 29 07:44:02 user nova-compute[75373]:       </nova:ports>
Nov 29 07:44:02 user nova-compute[75373]:     </nova:instance>
Nov 29 07:44:02 user nova-compute[75373]:   </metadata>
Nov 29 07:44:02 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:44:02 user nova-compute[75373]:     <system>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="serial">f66de8ab-d248-4064-a13a-8c7d9a81aff9</entry>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="uuid">f66de8ab-d248-4064-a13a-8c7d9a81aff9</entry>
Nov 29 07:44:02 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:44:02 user nova-compute[75373]:     </system>
Nov 29 07:44:02 user nova-compute[75373]:   </sysinfo>
Nov 29 07:44:02 user nova-compute[75373]:   <os>
Nov 29 07:44:02 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:44:02 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:44:02 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:44:02 user nova-compute[75373]:   </os>
Nov 29 07:44:02 user nova-compute[75373]:   <features>
Nov 29 07:44:02 user nova-compute[75373]:     <acpi/>
Nov 29 07:44:02 user nova-compute[75373]:     <apic/>
Nov 29 07:44:02 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:44:02 user nova-compute[75373]:   </features>
Nov 29 07:44:02 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:44:02 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:44:02 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:44:02 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:44:02 user nova-compute[75373]:   </clock>
Nov 29 07:44:02 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:44:02 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:44:02 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:44:02 user nova-compute[75373]:   </cpu>
Nov 29 07:44:02 user nova-compute[75373]:   <devices>
Nov 29 07:44:02 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:44:02 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:02 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:44:02 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:44:02 user nova-compute[75373]:       <serial>79e139fa-917d-47a7-8f29-e7dc84ecbfe2</serial>
Nov 29 07:44:02 user nova-compute[75373]:     </disk>
Nov 29 07:44:02 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:44:02 user nova-compute[75373]:       <mac address="fa:16:3e:67:ed:8c"/>
Nov 29 07:44:02 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:44:02 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:44:02 user nova-compute[75373]:       <target dev="tape7980c5b-bb"/>
Nov 29 07:44:02 user nova-compute[75373]:     </interface>
Nov 29 07:44:02 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:44:02 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9/console.log" append="off"/>
Nov 29 07:44:02 user nova-compute[75373]:     </serial>
Nov 29 07:44:02 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:44:02 user nova-compute[75373]:     <video>
Nov 29 07:44:02 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:44:02 user nova-compute[75373]:     </video>
Nov 29 07:44:02 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:44:02 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:44:02 user nova-compute[75373]:     </rng>
Nov 29 07:44:02 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:44:02 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:44:02 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:44:02 user nova-compute[75373]:     </memballoon>
Nov 29 07:44:02 user nova-compute[75373]:   </devices>
Nov 29 07:44:02 user nova-compute[75373]: </domain>
Nov 29 07:44:02 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-573824224',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:43:52Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG os_vif [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1408df5-b3b0-5d9b-8aec-f7f69063f3ce', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7980c5b-bb, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7980c5b-bb, col_values=(('qos', UUID('3b1c7dde-90f7-4f37-8ab7-83d0d462697f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7980c5b-bb, col_values=(('external_ids', {'iface-id': 'e7980c5b-bb5d-42b0-baa4-36c5f9863c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:ed:8c', 'vm-uuid': 'f66de8ab-d248-4064-a13a-8c7d9a81aff9'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:02 user nova-compute[75373]: INFO os_vif [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb')
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:44:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] No VIF found with MAC fa:16:3e:67:ed:8c, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:44:04 user nova-compute[75373]: WARNING nova.compute.manager [req-22506719-42a7-4a65-aac6-41168d76e316 req-3faabf85-0614-4299-bf1c-bf585882c999 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:44:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance spawned successfully.
Nov 29 07:44:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ef1faa60-1331-404c-ac42-1abb1a769893 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.120s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:44:06 user nova-compute[75373]: WARNING nova.compute.manager [req-7005e491-7b9c-4116-973d-db25639c6f4e req-98142af0-ae15-4a82-94a2-953c54b7118a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state active and task_state None.
Nov 29 07:44:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-changed-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Refreshing instance network info cache due to event network-changed-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] Acquiring lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] Acquired lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Refreshing network info cache for port 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updated VIF entry in instance network info cache for port 29b47a29-ad9b-4e98-8a0a-e5f6bb62655e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating instance_info_cache with network_info: [{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-efb86816-5556-46c2-9831-0d59a7df92e6 req-ec18e250-d4f8-4760-b70b-ea07f505b6c3 service nova] Releasing lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:44:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lazy-loading 'flavor' on Instance uuid 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:17 user nova-compute[75373]: INFO nova.compute.manager [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Attaching volume 79d50874-1cd3-422c-80ec-34029820f7d0 to /dev/vdb
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.utils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ab2eb-b513-4afe-9569-efa2198b3ccf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77f9ac-9e78-4209-b3b4-784d0f814d9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7223d7f-1c20-4c64-bd54-9378bfc64df0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bcdae8-df76-4c03-8217-7327a892ba48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:44:17 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:44:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ac809-8ad5-4105-ac9f-6917cbbe332a]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG os_brick.utils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating existing volume attachment record: f917efd0-3576-4b29-b6fa-461cefafdaff {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:44:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:22 user nova-compute[75373]: INFO nova.compute.manager [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Detaching volume 27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:44:22 user nova-compute[75373]: INFO nova.virt.block_device [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Attempting to driver detach volume 27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e from mountpoint /dev/vdb
Nov 29 07:44:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Attempting to detach device vdb from instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:44:22 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:22 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:44:22 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:44:22 user nova-compute[75373]:   <serial>27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e</serial>
Nov 29 07:44:22 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:44:22 user nova-compute[75373]: </disk>
Nov 29 07:44:22 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:44:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Successfully detached device vdb from instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 from the persistent domain config.
Nov 29 07:44:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:44:22 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:22 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:44:22 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:44:22 user nova-compute[75373]:   <serial>27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e</serial>
Nov 29 07:44:22 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:44:22 user nova-compute[75373]: </disk>
Nov 29 07:44:22 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:44:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIxOGCVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:44:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:25 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e44b384-1b98-4fb8-9a82-5b0b57ac4d0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:44:25 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[96053e28-eead-4ed9-904c-6fb99905ba42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0] added
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8af9a0-31b9-4156-8ba3-1d7572b66ae8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[347fdabb-a10c-4d7f-917a-898596079da5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIxOGCVb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIxOGCVb" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1036423-35a4-414a-b45e-9f2e6cd739ce]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MIxOGCVb'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22e7ec-ab28-4e1f-abf6-1537fe7b0ddb]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3fda9b-2876-432d-838e-ce5dbcdda21d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde8486-d7f2-496e-8f99-1a68dd5d127f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260]
Nov 29 07:44:25 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260] successful.
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a14ae-b211-4c63-b449-8a7a09adf686]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9dcb6-7eb4-4d3c-b33c-52f8854bf462]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd92bad-7eb2-4033-bce9-21578734c125]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIxOGCVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26234653061616264', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653061616264', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lazy-loading 'flavor' on Instance uuid 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:44:26 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:26 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:44:26 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:44:26 user nova-compute[75373]:   <serial>79d50874-1cd3-422c-80ec-34029820f7d0</serial>
Nov 29 07:44:26 user nova-compute[75373]: </disk>
Nov 29 07:44:26 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] No VIF found with MAC fa:16:3e:64:0b:75, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:44:26 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0eb69053-7ffd-4589-b61c-7afd94006835 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.350s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:28 user nova-compute[75373]: INFO nova.compute.manager [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Detaching volume 79d50874-1cd3-422c-80ec-34029820f7d0
Nov 29 07:44:28 user nova-compute[75373]: INFO nova.virt.block_device [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Attempting to driver detach volume 79d50874-1cd3-422c-80ec-34029820f7d0 from mountpoint /dev/vdb
Nov 29 07:44:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Attempting to detach device vdb from instance 53f246fb-2511-4586-be4d-17413b4ac2a8 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:44:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:44:28 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:28 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:44:28 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:44:28 user nova-compute[75373]:   <serial>79d50874-1cd3-422c-80ec-34029820f7d0</serial>
Nov 29 07:44:28 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:44:28 user nova-compute[75373]: </disk>
Nov 29 07:44:28 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:44:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Successfully detached device vdb from instance 53f246fb-2511-4586-be4d-17413b4ac2a8 from the persistent domain config.
Nov 29 07:44:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53f246fb-2511-4586-be4d-17413b4ac2a8 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:44:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:44:28 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:44:28 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:44:28 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:44:28 user nova-compute[75373]:   <serial>79d50874-1cd3-422c-80ec-34029820f7d0</serial>
Nov 29 07:44:28 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:44:28 user nova-compute[75373]: </disk>
Nov 29 07:44:28 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:44:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:31 user nova-compute[75373]: INFO nova.compute.manager [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Terminating instance
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-unplugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] No waiting events found dispatching network-vif-unplugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-d6d7546b-225d-4fa1-9332-4af475d0a903 req-a0b44323-4927-4ee5-93c1-9591f2024713 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-unplugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:44:31 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Instance destroyed successfully.
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.objects.instance [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lazy-loading 'resources' on Instance uuid 7c25504f-ed6b-409c-8849-68c1ca27fe93 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-245583955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-245583955',id=17,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff517549ee99421aa0e9d570d4fb6941',ramdisk_id='',reservation_id='r-kktjl5mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:26:49Z,user_data=None,user_id='b7dec6d7789c4430ad19e175de4b3519',uuid=7c25504f-ed6b-409c-8849-68c1ca27fe93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converting VIF {"id": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "address": "fa:16:3e:d9:c1:52", "network": {"id": "62142305-3aa0-474d-86cd-670dcc9a80df", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1208651613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff517549ee99421aa0e9d570d4fb6941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape063aa71-dd", "ovs_interfaceid": "e063aa71-dd31-4af0-9d79-10dcd9c036d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG os_vif [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape063aa71-dd, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b575df7d-e05a-41f0-9439-e599cc0d00f2) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:31 user nova-compute[75373]: INFO os_vif [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:c1:52,bridge_name='br-int',has_traffic_filtering=True,id=e063aa71-dd31-4af0-9d79-10dcd9c036d0,network=Network(62142305-3aa0-474d-86cd-670dcc9a80df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape063aa71-dd')
Nov 29 07:44:31 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Deleting instance files /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93_del
Nov 29 07:44:31 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Deletion of /opt/stack/data/nova/instances/7c25504f-ed6b-409c-8849-68c1ca27fe93_del complete
Nov 29 07:44:32 user nova-compute[75373]: INFO nova.compute.manager [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 29 07:44:32 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:32 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Took 0.41 seconds to deallocate network for instance.
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-279b80a6-a29a-4db9-b477-c1e04ec5bc27 req-fac6324c-59d4-4c37-9c15-a30f2c8020b5 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-deleted-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:32 user nova-compute[75373]: INFO nova.compute.manager [req-279b80a6-a29a-4db9-b477-c1e04ec5bc27 req-fac6324c-59d4-4c37-9c15-a30f2c8020b5 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Neutron deleted interface e063aa71-dd31-4af0-9d79-10dcd9c036d0; detaching it from the instance and deleting it from the info cache
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.network.neutron [req-279b80a6-a29a-4db9-b477-c1e04ec5bc27 req-fac6324c-59d4-4c37-9c15-a30f2c8020b5 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.compute.manager [req-279b80a6-a29a-4db9-b477-c1e04ec5bc27 req-fac6324c-59d4-4c37-9c15-a30f2c8020b5 service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Detach interface failed, port_id=e063aa71-dd31-4af0-9d79-10dcd9c036d0, reason: Instance 7c25504f-ed6b-409c-8849-68c1ca27fe93 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:44:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:32 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Deleted allocations for instance 7c25504f-ed6b-409c-8849-68c1ca27fe93
Nov 29 07:44:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-355ec837-ef2d-4c22-9eba-75a0cee472bf tempest-ServerBootFromVolumeStableRescueTest-1839777950 tempest-ServerBootFromVolumeStableRescueTest-1839777950-project-member] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:44:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] Acquiring lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] Lock "7c25504f-ed6b-409c-8849-68c1ca27fe93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] No waiting events found dispatching network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:44:33 user nova-compute[75373]: WARNING nova.compute.manager [req-775e960d-ec52-46d5-a113-7b28df2b3508 req-7345dcbd-eea1-4e07-b2ed-8a98a969ec8e service nova] [instance: 7c25504f-ed6b-409c-8849-68c1ca27fe93] Received unexpected event network-vif-plugged-e063aa71-dd31-4af0-9d79-10dcd9c036d0 for instance with vm_state deleted and task_state None.
Nov 29 07:44:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:42 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 is timed out.
Nov 29 07:44:42 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Successfully detached device vdb from instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 from the live domain config.
Nov 29 07:44:42 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLGXNoIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:44:42 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[798dd41a-89bc-4ca5-b408-dc603a1f27d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:44:42 user nova-compute[75373]: No targets found.
Nov 29 07:44:42 user nova-compute[75373]: iSNS:
Nov 29 07:44:42 user nova-compute[75373]: No targets found.
Nov 29 07:44:42 user nova-compute[75373]: STATIC:
Nov 29 07:44:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e
Nov 29 07:44:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:44:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:44:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0
Nov 29 07:44:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:44:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:44:42 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2
Nov 29 07:44:42 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:44:42 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:44:42 user nova-compute[75373]: FIRMWARE:
Nov 29 07:44:42 user nova-compute[75373]: No targets found.
Nov 29 07:44:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:44:42 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:44:42 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af2843-7179-4da9-8f61-2b2b651976df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982db5d-3df3-40d6-92c6-40ad3c3ec576]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:42 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:42 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e (non-flash)
Nov 29 07:44:42 user nova-compute[75373]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:42 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0492c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e92dab-0f8e-4d00-aeaa-e84f1cf0eeb9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c6acb3-63fc-4546-9997-cbfed86ee1b7]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[824aa3ac-fb2f-4763-add1-fa8b8abe75a9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c78542-b4af-4f63-a214-c109b612cfe9]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5721194-1919-4ae8-9983-cd3ae6bb7365]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644c69f-dd28-43fa-a53b-e1e2354153d6]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260]
Nov 29 07:44:42 user nova-compute[75373]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e, portal: 172.16.0.220,3260] successful.
Nov 29 07:44:42 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:42 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27dbfc53-75d1-4d1a-b3a7-1407ee2ff29e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4492bd9-cf14-40b0-bedc-a0bb689c44bc]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] <== disconnect_volume: return (337ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG nova.objects.instance [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'flavor' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-429175e9-f3dc-411e-8821-70a86b1628c2 tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:44:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:44:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:44:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:44:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating instance_info_cache with network_info: [{"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:44:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-53f246fb-2511-4586-be4d-17413b4ac2a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:44:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:44:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 53f246fb-2511-4586-be4d-17413b4ac2a8 is timed out.
Nov 29 07:44:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Successfully detached device vdb from instance 53f246fb-2511-4586-be4d-17413b4ac2a8 from the live domain config.
Nov 29 07:44:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIxOGCVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:44:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b09e746-7cf5-4366-b0aa-fb7957be3c79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:44:48 user nova-compute[75373]: No targets found.
Nov 29 07:44:48 user nova-compute[75373]: iSNS:
Nov 29 07:44:48 user nova-compute[75373]: No targets found.
Nov 29 07:44:48 user nova-compute[75373]: STATIC:
Nov 29 07:44:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0
Nov 29 07:44:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:44:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:44:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2
Nov 29 07:44:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:44:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:44:48 user nova-compute[75373]: FIRMWARE:
Nov 29 07:44:48 user nova-compute[75373]: No targets found.
Nov 29 07:44:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:44:48 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:44:48 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f78599-fe88-431b-ab90-d7a15d266e82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98e7e8-743d-4b29-ba7e-449fcf894fbb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:48 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:44:48 user nova-compute[75373]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 (non-flash)
Nov 29 07:44:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae01841f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b184e6-aeae-4d90-a061-904e03ddfefb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bd7922-736a-4cab-ac88-6eda38d147fd]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:44:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165ae30-6c71-4058-87da-900b0b4e0e77]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901ab4e-30a5-4d67-8a5f-1f676c75d72a]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[19369cf0-e983-4f51-bff6-774787d15cc6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5699980-232b-438d-a628-ab12e187cf03]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260]
Nov 29 07:44:49 user nova-compute[75373]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0, portal: 172.16.0.220,3260] successful.
Nov 29 07:44:49 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d50874-1cd3-422c-80ec-34029820f7d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0652387f-a4f3-46fb-b666-cd89cad125f8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] <== disconnect_volume: return (361ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG nova.objects.instance [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lazy-loading 'flavor' on Instance uuid 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:44:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c1-86b0-433f-8a38-24328d982856 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:44:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:55 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:55 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:44:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:44:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:44:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.011859893798828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 53f246fb-2511-4586-be4d-17413b4ac2a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance f66de8ab-d248-4064-a13a-8c7d9a81aff9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:44:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:12 user nova-compute[75373]: INFO nova.compute.manager [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Terminating instance
Nov 29 07:45:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.compute.manager [req-10d11177-d964-4799-b2d3-4ef1c32032e6 req-ccb848f4-8af4-4d78-a0fd-d7b3201bbd4a service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-unplugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Instance destroyed successfully.
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lazy-loading 'resources' on Instance uuid b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1386571198',display_name='tempest-ServerStableDeviceRescueTest-server-1386571198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1386571198',id=37,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3gBi1mV/8pxaPbDcJaalYHnRU4Ag2AHamBhfWTe1ESUYqIjvCef5yCJfsldoX+hbSJttpQF2UFgwwJhUl/izFDQQE991o1JqeFoRM8ZNAXaN4koHXvjAOix/ChKdnIbg==',key_name='tempest-keypair-302191484',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:42:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db2b708cb1df4d2ea2536831e3d83206',ramdisk_id='',reservation_id='r-8j44pxcu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-977224491',owner_user_name='tempest-ServerStableDeviceRescueTest-977224491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='809d6d574ea2441a9a2c24be9c409139',uuid=b819f808-d0cf-4db5-89d6-5b3a2dfec6a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converting VIF {"id": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "address": "fa:16:3e:92:40:cd", "network": {"id": "5ed42bde-5dd9-418c-9458-591f7143eaf3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-635245161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db2b708cb1df4d2ea2536831e3d83206", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fbaa44-3b", "ovs_interfaceid": "c2fbaa44-3b2e-4473-b109-19a8e355ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG os_vif [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2fbaa44-3b, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d9084cc-d4bf-487e-a335-2fc719ab1d82) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:13 user nova-compute[75373]: INFO os_vif [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:40:cd,bridge_name='br-int',has_traffic_filtering=True,id=c2fbaa44-3b2e-4473-b109-19a8e355ed59,network=Network(5ed42bde-5dd9-418c-9458-591f7143eaf3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fbaa44-3b')
Nov 29 07:45:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Deleting instance files /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5_del
Nov 29 07:45:13 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Deletion of /opt/stack/data/nova/instances/b819f808-d0cf-4db5-89d6-5b3a2dfec6a5_del complete
Nov 29 07:45:13 user nova-compute[75373]: INFO nova.compute.manager [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 07:45:13 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:45:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:14 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Took 0.90 seconds to deallocate network for instance.
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-a803f115-60da-4c2b-87bc-11777e7dd567 req-2b347aa3-b044-4b3c-9eb6-2ab1e4842733 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-deleted-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:14 user nova-compute[75373]: INFO nova.compute.manager [req-a803f115-60da-4c2b-87bc-11777e7dd567 req-2b347aa3-b044-4b3c-9eb6-2ab1e4842733 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Neutron deleted interface c2fbaa44-3b2e-4473-b109-19a8e355ed59; detaching it from the instance and deleting it from the info cache
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.network.neutron [req-a803f115-60da-4c2b-87bc-11777e7dd567 req-2b347aa3-b044-4b3c-9eb6-2ab1e4842733 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.compute.manager [req-a803f115-60da-4c2b-87bc-11777e7dd567 req-2b347aa3-b044-4b3c-9eb6-2ab1e4842733 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Detach interface failed, port_id=c2fbaa44-3b2e-4473-b109-19a8e355ed59, reason: Instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:45:14 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:14 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Deleted allocations for instance b819f808-d0cf-4db5-89d6-5b3a2dfec6a5
Nov 29 07:45:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0d83b7a1-081e-4a7f-bc34-6d72ea69edab tempest-ServerStableDeviceRescueTest-977224491 tempest-ServerStableDeviceRescueTest-977224491-project-member] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] Acquiring lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] Lock "b819f808-d0cf-4db5-89d6-5b3a2dfec6a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:15 user nova-compute[75373]: DEBUG nova.compute.manager [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] No waiting events found dispatching network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:15 user nova-compute[75373]: WARNING nova.compute.manager [req-ee7b61c0-6dc0-4587-8ff1-9e169a3ccffc req-d8452ffe-184b-45b0-a5dd-25b9c54f8d68 service nova] [instance: b819f808-d0cf-4db5-89d6-5b3a2dfec6a5] Received unexpected event network-vif-plugged-c2fbaa44-3b2e-4473-b109-19a8e355ed59 for instance with vm_state deleted and task_state None.
Nov 29 07:45:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:21 user nova-compute[75373]: INFO nova.compute.manager [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Terminating instance
Nov 29 07:45:21 user nova-compute[75373]: DEBUG nova.compute.manager [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-d061fea4-fab3-456b-9558-57c87003a12b req-f4667ef8-a3da-472d-9d78-002762f67422 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Instance destroyed successfully.
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.objects.instance [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lazy-loading 'resources' on Instance uuid 53f246fb-2511-4586-be4d-17413b4ac2a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-121016703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1210167',id=40,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIb23Uhn+YtarXM0VZIYh6kKV+R2bLBaVQ+x4gpYTPqeJUMNH8G2wqczF1poSmbVED8itO4EvH2R7HPmiwodEo155rh9TtCs+VmVuFvKYoHo/K5lbCeU28HxPa5FxF1cmw==',key_name='tempest-keypair-1746303401',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:42:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60d981da33f04ed6a957a1df16fca63c',ramdisk_id='',reservation_id='r-4v7wn0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e56dc3bced44898bd6abd5b6e135e2b',uuid=53f246fb-2511-4586-be4d-17413b4ac2a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converting VIF {"id": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "address": "fa:16:3e:64:0b:75", "network": {"id": "4637e07a-a598-4f17-b137-825f404da5b7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-152870052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60d981da33f04ed6a957a1df16fca63c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b47a29-ad", "ovs_interfaceid": "29b47a29-ad9b-4e98-8a0a-e5f6bb62655e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG os_vif [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b47a29-ad, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb860167-18e2-4324-b023-5243b9316cfb) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:22 user nova-compute[75373]: INFO os_vif [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=29b47a29-ad9b-4e98-8a0a-e5f6bb62655e,network=Network(4637e07a-a598-4f17-b137-825f404da5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b47a29-ad')
Nov 29 07:45:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Deleting instance files /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8_del
Nov 29 07:45:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Deletion of /opt/stack/data/nova/instances/53f246fb-2511-4586-be4d-17413b4ac2a8_del complete
Nov 29 07:45:22 user nova-compute[75373]: INFO nova.compute.manager [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 07:45:22 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:45:22 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:23 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Took 1.03 seconds to deallocate network for instance.
Nov 29 07:45:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Deleted allocations for instance 53f246fb-2511-4586-be4d-17413b4ac2a8
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5fcb8f00-6677-49d7-9632-8f970daa3238 tempest-TestServerVolumeAttachScenarioOldVersion-810519940 tempest-TestServerVolumeAttachScenarioOldVersion-810519940-project-member] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:24 user nova-compute[75373]: WARNING nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state deleted and task_state None.
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:24 user nova-compute[75373]: WARNING nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state deleted and task_state None.
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:24 user nova-compute[75373]: WARNING nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state deleted and task_state None.
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:24 user nova-compute[75373]: WARNING nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-unplugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state deleted and task_state None.
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Acquiring lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] Lock "53f246fb-2511-4586-be4d-17413b4ac2a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] No waiting events found dispatching network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:24 user nova-compute[75373]: WARNING nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received unexpected event network-vif-plugged-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e for instance with vm_state deleted and task_state None.
Nov 29 07:45:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-ce6b31d3-538b-4a23-8bce-a44ecba6234a req-fbc450e9-12cd-46df-8213-a8102704f597 service nova] [instance: 53f246fb-2511-4586-be4d-17413b4ac2a8] Received event network-vif-deleted-29b47a29-ad9b-4e98-8a0a-e5f6bb62655e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:45:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:45:42 user nova-compute[75373]: INFO nova.compute.claims [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Claim successful on node user
Nov 29 07:45:42 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:45:42 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:45:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.policy [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbd11ce2cf2d44dfb93698957345af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94757d2dab4b41a9806300d87e6769b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:45:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Creating image(s)
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "/opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "/opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk 1073741824" returned: 0 in 0.065s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:45:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Successfully created port: 1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Cannot resize image /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Ensure instance console log exists: /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing instance network info cache due to event network-changed-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] Acquiring lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] Acquired lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.network.neutron [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Refreshing network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:44 user nova-compute[75373]: INFO nova.compute.manager [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Terminating instance
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Skipping network cache update for instance because it is being deleted. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 07:45:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 07:45:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Instance destroyed successfully.
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.objects.instance [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lazy-loading 'resources' on Instance uuid f66de8ab-d248-4064-a13a-8c7d9a81aff9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T07:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1814460307',display_name='tempest-TestShelveInstance-server-1814460307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1814460307',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCePht6phlCj5AAAtGEeqWHlduphWnWp6IPt44audw7zKbVTtGgNmcQ4RsT3H6ZTD+2L7nN48T1uPfiFsgfjEiUHd3TPGATSqfy05hE7bYqmBvylKMJnCcmK1s/BJIYX3g==',key_name='tempest-TestShelveInstance-573824224',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d47faf322a2e4f75bb17ff43013a863e',ramdisk_id='',reservation_id='r-y7mtqqlm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-885872690',owner_user_name='tempest-TestShelveInstance-885872690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:44:07Z,user_data=None,user_id='6f1e0b9fc9c74de2b0fc76b85ad16af0',uuid=f66de8ab-d248-4064-a13a-8c7d9a81aff9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converting VIF {"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_vif [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7980c5b-bb, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b1c7dde-90f7-4f37-8ab7-83d0d462697f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: INFO os_vif [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:ed:8c,bridge_name='br-int',has_traffic_filtering=True,id=e7980c5b-bb5d-42b0-baa4-36c5f9863c9e,network=Network(958e5261-c894-4501-b213-c0b67af34e9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7980c5b-bb')
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfbkuSRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:45:45 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a441e2-ae1e-40f8-82a2-6448cd129eac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:45:45 user nova-compute[75373]: No targets found.
Nov 29 07:45:45 user nova-compute[75373]: iSNS:
Nov 29 07:45:45 user nova-compute[75373]: No targets found.
Nov 29 07:45:45 user nova-compute[75373]: STATIC:
Nov 29 07:45:45 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2
Nov 29 07:45:45 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:45:45 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:45:45 user nova-compute[75373]: FIRMWARE:
Nov 29 07:45:45 user nova-compute[75373]: No targets found.
Nov 29 07:45:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:45:45 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:45:45 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82dfda-b6f3-4736-be51-4514f6f10b18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd769a0-33f6-4eed-bd08-ec90efe0d082]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:45:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 (non-flash)
Nov 29 07:45:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0041bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Successfully updated port: 1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1fb6e8-b284-4826-b342-3dc029ab2c14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquired lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updated VIF entry in instance network info cache for port e7980c5b-bb5d-42b0-baa4-36c5f9863c9e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [{"id": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "address": "fa:16:3e:67:ed:8c", "network": {"id": "958e5261-c894-4501-b213-c0b67af34e9a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1821941655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d47faf322a2e4f75bb17ff43013a863e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7980c5b-bb", "ovs_interfaceid": "e7980c5b-bb5d-42b0-baa4-36c5f9863c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[83676672-cc99-436c-851d-9f2462d1f822]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-71dcadee-0b37-4a69-855e-4fcd66257c04 req-532dff0a-96ca-4a3a-8c66-44382b41fbd3 service nova] Releasing lock "refresh_cache-f66de8ab-d248-4064-a13a-8c7d9a81aff9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0982fc-2029-455d-8d6f-6ddfea9bde76]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d0777b-0af0-4b74-8c84-5c208d6f8c6e]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47a252-e4fc-4cd4-bae1-d495087afdf2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e70ef-c51f-4c0f-ae7e-acca8565b1ed]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260]
Nov 29 07:45:45 user nova-compute[75373]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2, portal: 172.16.0.220,3260] successful.
Nov 29 07:45:45 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79e139fa-917d-47a7-8f29-e7dc84ecbfe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c6694a-c96e-4c77-be67-88aec9fa982b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] <== disconnect_volume: return (312ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:45:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deleting instance files /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9_del
Nov 29 07:45:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deletion of /opt/stack/data/nova/instances/f66de8ab-d248-4064-a13a-8c7d9a81aff9_del complete
Nov 29 07:45:45 user nova-compute[75373]: INFO nova.compute.manager [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updating instance_info_cache with network_info: [{"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Releasing lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Instance network_info: |[{"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Start _get_guest_xml network_info=[{"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:45:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:45:45 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721019479',display_name='tempest-VolumesActionsTest-instance-721019479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721019479',id=41,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94757d2dab4b41a9806300d87e6769b3',ramdisk_id='',reservation_id='r-wk08hzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1261554137',owner_user_name='tempest-VolumesActionsTest-1261554137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:45:43Z,user_data=None,user_id='fbd11ce2cf2d44dfb93698957345af64',uuid=b0621c2c-d84a-43dd-a8e9-a2561bea00a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converting VIF {"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lazy-loading 'pci_devices' on Instance uuid b0621c2c-d84a-43dd-a8e9-a2561bea00a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:45:45 user nova-compute[75373]:   <uuid>b0621c2c-d84a-43dd-a8e9-a2561bea00a8</uuid>
Nov 29 07:45:45 user nova-compute[75373]:   <name>instance-00000029</name>
Nov 29 07:45:45 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:45:45 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:45:45 user nova-compute[75373]:   <metadata>
Nov 29 07:45:45 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:45:45 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:name>tempest-VolumesActionsTest-instance-721019479</nova:name>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:45:45</nova:creationTime>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:45:45 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:45:45 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:owner>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:user uuid="fbd11ce2cf2d44dfb93698957345af64">tempest-VolumesActionsTest-1261554137-project-member</nova:user>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:project uuid="94757d2dab4b41a9806300d87e6769b3">tempest-VolumesActionsTest-1261554137</nova:project>
Nov 29 07:45:45 user nova-compute[75373]:       </nova:owner>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:45:45 user nova-compute[75373]:       <nova:ports>
Nov 29 07:45:45 user nova-compute[75373]:         <nova:port uuid="1ab3a247-88f9-46c4-a56d-13a618afbe7f">
Nov 29 07:45:45 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 07:45:45 user nova-compute[75373]:         </nova:port>
Nov 29 07:45:45 user nova-compute[75373]:       </nova:ports>
Nov 29 07:45:45 user nova-compute[75373]:     </nova:instance>
Nov 29 07:45:45 user nova-compute[75373]:   </metadata>
Nov 29 07:45:45 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:45:45 user nova-compute[75373]:     <system>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="serial">b0621c2c-d84a-43dd-a8e9-a2561bea00a8</entry>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="uuid">b0621c2c-d84a-43dd-a8e9-a2561bea00a8</entry>
Nov 29 07:45:45 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:45:45 user nova-compute[75373]:     </system>
Nov 29 07:45:45 user nova-compute[75373]:   </sysinfo>
Nov 29 07:45:45 user nova-compute[75373]:   <os>
Nov 29 07:45:45 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:45:45 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:45:45 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:45:45 user nova-compute[75373]:   </os>
Nov 29 07:45:45 user nova-compute[75373]:   <features>
Nov 29 07:45:45 user nova-compute[75373]:     <acpi/>
Nov 29 07:45:45 user nova-compute[75373]:     <apic/>
Nov 29 07:45:45 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:45:45 user nova-compute[75373]:   </features>
Nov 29 07:45:45 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:45:45 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:45:45 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:45:45 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:45:45 user nova-compute[75373]:   </clock>
Nov 29 07:45:45 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:45:45 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:45:45 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:45:45 user nova-compute[75373]:   </cpu>
Nov 29 07:45:45 user nova-compute[75373]:   <devices>
Nov 29 07:45:45 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:45:45 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:45:45 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk"/>
Nov 29 07:45:45 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:45:45 user nova-compute[75373]:     </disk>
Nov 29 07:45:45 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:45:45 user nova-compute[75373]:       <mac address="fa:16:3e:eb:d3:87"/>
Nov 29 07:45:45 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:45:45 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:45:45 user nova-compute[75373]:       <target dev="tap1ab3a247-88"/>
Nov 29 07:45:45 user nova-compute[75373]:     </interface>
Nov 29 07:45:45 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:45:45 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/console.log" append="off"/>
Nov 29 07:45:45 user nova-compute[75373]:     </serial>
Nov 29 07:45:45 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:45:45 user nova-compute[75373]:     <video>
Nov 29 07:45:45 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:45:45 user nova-compute[75373]:     </video>
Nov 29 07:45:45 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:45:45 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:45:45 user nova-compute[75373]:     </rng>
Nov 29 07:45:45 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:45:45 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:45:45 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:45:45 user nova-compute[75373]:     </memballoon>
Nov 29 07:45:45 user nova-compute[75373]:   </devices>
Nov 29 07:45:45 user nova-compute[75373]: </domain>
Nov 29 07:45:45 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721019479',display_name='tempest-VolumesActionsTest-instance-721019479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721019479',id=41,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94757d2dab4b41a9806300d87e6769b3',ramdisk_id='',reservation_id='r-wk08hzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1261554137',owner_user_name='tempest-VolumesActionsTest-1261554137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:45:43Z,user_data=None,user_id='fbd11ce2cf2d44dfb93698957345af64',uuid=b0621c2c-d84a-43dd-a8e9-a2561bea00a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converting VIF {"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG os_vif [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f1d9aa3-1f45-5321-931c-1a4ebbcc08f7', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ab3a247-88, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ab3a247-88, col_values=(('qos', UUID('d8bc24c9-d43f-4295-87ce-4ee99b891dbd')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ab3a247-88, col_values=(('external_ids', {'iface-id': '1ab3a247-88f9-46c4-a56d-13a618afbe7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:d3:87', 'vm-uuid': 'b0621c2c-d84a-43dd-a8e9-a2561bea00a8'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:45 user nova-compute[75373]: INFO os_vif [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88')
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] No VIF found with MAC fa:16:3e:eb:d3:87, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:45:45 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:45 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Took 0.47 seconds to deallocate network for instance.
Nov 29 07:45:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-unplugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Acquiring lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] No waiting events found dispatching network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:46 user nova-compute[75373]: WARNING nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received unexpected event network-vif-plugged-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e for instance with vm_state active and task_state deleting.
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-changed-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Refreshing instance network info cache due to event network-changed-1ab3a247-88f9-46c4-a56d-13a618afbe7f. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Acquiring lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Acquired lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.network.neutron [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Refreshing network info cache for port 1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.network.neutron [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updated VIF entry in instance network info cache for port 1ab3a247-88f9-46c4-a56d-13a618afbe7f. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.network.neutron [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updating instance_info_cache with network_info: [{"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] Releasing lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ac83ba04-5b00-4a64-94e8-ca9f42c9dfab req-f903b263-4492-4939-9090-c958047bc34a service nova] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Received event network-vif-deleted-e7980c5b-bb5d-42b0-baa4-36c5f9863c9e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:46 user nova-compute[75373]: INFO nova.compute.manager [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 07:45:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] [instance: f66de8ab-d248-4064-a13a-8c7d9a81aff9] Deleting volume: 79e139fa-917d-47a7-8f29-e7dc84ecbfe2 {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:47 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Deleted allocations for instance f66de8ab-d248-4064-a13a-8c7d9a81aff9
Nov 29 07:45:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5c7d62c6-afee-44c0-a48f-d6dffee0aa16 tempest-TestShelveInstance-885872690 tempest-TestShelveInstance-885872690-project-member] Lock "f66de8ab-d248-4064-a13a-8c7d9a81aff9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] No waiting events found dispatching network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:48 user nova-compute[75373]: WARNING nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received unexpected event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f for instance with vm_state building and task_state spawning.
Nov 29 07:45:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:48 user nova-compute[75373]: DEBUG nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] No waiting events found dispatching network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:45:48 user nova-compute[75373]: WARNING nova.compute.manager [req-d8c591f4-9441-45fd-a932-68889ef579c8 req-3fff5148-1fb0-46b0-8996-8e15b1c5b9e6 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received unexpected event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f for instance with vm_state building and task_state spawning.
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:45:49 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Instance spawned successfully.
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:45:49 user nova-compute[75373]: INFO nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 29 07:45:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:45:49 user nova-compute[75373]: INFO nova.compute.manager [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Took 6.72 seconds to build instance.
Nov 29 07:45:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b1f870c3-2029-4b1a-beb8-4708b0f9587f tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.821s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:45:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:45:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:45:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:45:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.161357879638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b0621c2c-d84a-43dd-a8e9-a2561bea00a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:45:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:43 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:46:43 user nova-compute[75373]: INFO nova.compute.claims [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Claim successful on node user
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:46:44 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:46:44 user nova-compute[75373]: DEBUG nova.policy [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:46:44 user nova-compute[75373]: INFO nova.virt.block_device [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Booting with volume snapshot f8068364-0f44-4506-80f1-a598c64f3bd8 at /dev/vda
Nov 29 07:46:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Successfully created port: f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:46:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Successfully updated port: f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-changed-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Refreshing instance network info cache due to event network-changed-f09588d4-dbbb-495b-8331-25881e3028a5. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] Acquiring lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:46:46 user nova-compute[75373]: INFO nova.compute.claims [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Claim successful on node user
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid b0621c2c-d84a-43dd-a8e9-a2561bea00a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:46:46 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:46:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating instance_info_cache with network_info: [{"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Instance network_info: |[{"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] Acquired lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Refreshing network info cache for port f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.policy [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82031ebcb0f49b39da9053f414c41be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720623ac15948c4b55f8185aeb213b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:46:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Creating image(s)
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "/opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "/opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "/opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updating instance_info_cache with network_info: [{"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-b0621c2c-d84a-43dd-a8e9-a2561bea00a8" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk 1073741824" returned: 0 in 0.049s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:46:47 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Cannot resize image /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Ensure instance console log exists: /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updated VIF entry in instance network info cache for port f09588d4-dbbb-495b-8331-25881e3028a5. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating instance_info_cache with network_info: [{"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff543442-f113-4211-ad9a-ece3cf823946 req-78e387fb-be4d-48ec-8fed-ac49c8b39079 service nova] Releasing lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:46:48 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Successfully created port: 46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Successfully updated port: 46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquired lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-changed-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Refreshing instance network info cache due to event network-changed-46d5bb5a-1fb3-43ae-b579-e16abfc9b751. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] Acquiring lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Updating instance_info_cache with network_info: [{"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Releasing lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Instance network_info: |[{"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] Acquired lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Refreshing network info cache for port 46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Start _get_guest_xml network_info=[{"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:46:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:49 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290773893',display_name='tempest-VolumesActionsTest-instance-290773893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-290773893',id=43,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-0mr1dxji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:46:47Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=888c3717-57c7-4c58-84ef-c0349a6a9735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.objects.instance [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lazy-loading 'pci_devices' on Instance uuid 888c3717-57c7-4c58-84ef-c0349a6a9735 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:46:49 user nova-compute[75373]:   <uuid>888c3717-57c7-4c58-84ef-c0349a6a9735</uuid>
Nov 29 07:46:49 user nova-compute[75373]:   <name>instance-0000002b</name>
Nov 29 07:46:49 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:46:49 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:46:49 user nova-compute[75373]:   <metadata>
Nov 29 07:46:49 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:46:49 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:name>tempest-VolumesActionsTest-instance-290773893</nova:name>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:46:49</nova:creationTime>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:46:49 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:46:49 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:owner>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:user uuid="a82031ebcb0f49b39da9053f414c41be">tempest-VolumesActionsTest-388158060-project-member</nova:user>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:project uuid="8720623ac15948c4b55f8185aeb213b1">tempest-VolumesActionsTest-388158060</nova:project>
Nov 29 07:46:49 user nova-compute[75373]:       </nova:owner>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:46:49 user nova-compute[75373]:       <nova:ports>
Nov 29 07:46:49 user nova-compute[75373]:         <nova:port uuid="46d5bb5a-1fb3-43ae-b579-e16abfc9b751">
Nov 29 07:46:49 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 07:46:49 user nova-compute[75373]:         </nova:port>
Nov 29 07:46:49 user nova-compute[75373]:       </nova:ports>
Nov 29 07:46:49 user nova-compute[75373]:     </nova:instance>
Nov 29 07:46:49 user nova-compute[75373]:   </metadata>
Nov 29 07:46:49 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:46:49 user nova-compute[75373]:     <system>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="serial">888c3717-57c7-4c58-84ef-c0349a6a9735</entry>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="uuid">888c3717-57c7-4c58-84ef-c0349a6a9735</entry>
Nov 29 07:46:49 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:46:49 user nova-compute[75373]:     </system>
Nov 29 07:46:49 user nova-compute[75373]:   </sysinfo>
Nov 29 07:46:49 user nova-compute[75373]:   <os>
Nov 29 07:46:49 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:46:49 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:46:49 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:46:49 user nova-compute[75373]:   </os>
Nov 29 07:46:49 user nova-compute[75373]:   <features>
Nov 29 07:46:49 user nova-compute[75373]:     <acpi/>
Nov 29 07:46:49 user nova-compute[75373]:     <apic/>
Nov 29 07:46:49 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:46:49 user nova-compute[75373]:   </features>
Nov 29 07:46:49 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:46:49 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:46:49 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:46:49 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:46:49 user nova-compute[75373]:   </clock>
Nov 29 07:46:49 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:46:49 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:46:49 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:46:49 user nova-compute[75373]:   </cpu>
Nov 29 07:46:49 user nova-compute[75373]:   <devices>
Nov 29 07:46:49 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:46:49 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:46:49 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk"/>
Nov 29 07:46:49 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:46:49 user nova-compute[75373]:     </disk>
Nov 29 07:46:49 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:46:49 user nova-compute[75373]:       <mac address="fa:16:3e:f0:e4:97"/>
Nov 29 07:46:49 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:46:49 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:46:49 user nova-compute[75373]:       <target dev="tap46d5bb5a-1f"/>
Nov 29 07:46:49 user nova-compute[75373]:     </interface>
Nov 29 07:46:49 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:46:49 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/console.log" append="off"/>
Nov 29 07:46:49 user nova-compute[75373]:     </serial>
Nov 29 07:46:49 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:46:49 user nova-compute[75373]:     <video>
Nov 29 07:46:49 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:46:49 user nova-compute[75373]:     </video>
Nov 29 07:46:49 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:46:49 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:46:49 user nova-compute[75373]:     </rng>
Nov 29 07:46:49 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:46:49 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:46:49 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:46:49 user nova-compute[75373]:     </memballoon>
Nov 29 07:46:49 user nova-compute[75373]:   </devices>
Nov 29 07:46:49 user nova-compute[75373]: </domain>
Nov 29 07:46:49 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290773893',display_name='tempest-VolumesActionsTest-instance-290773893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-290773893',id=43,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-0mr1dxji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:46:47Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=888c3717-57c7-4c58-84ef-c0349a6a9735,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG os_vif [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aca2096e-a800-583a-80af-c5dd47b66040', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46d5bb5a-1f, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46d5bb5a-1f, col_values=(('qos', UUID('9dfcf7c5-f6d7-4760-abd7-9fb4d931589a')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46d5bb5a-1f, col_values=(('external_ids', {'iface-id': '46d5bb5a-1fb3-43ae-b579-e16abfc9b751', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e4:97', 'vm-uuid': '888c3717-57c7-4c58-84ef-c0349a6a9735'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:49 user nova-compute[75373]: INFO os_vif [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f')
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] No VIF found with MAC fa:16:3e:f0:e4:97, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Updated VIF entry in instance network info cache for port 46d5bb5a-1fb3-43ae-b579-e16abfc9b751. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG nova.network.neutron [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Updating instance_info_cache with network_info: [{"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fae27f58-ad2b-4813-958b-31d142799d24 req-5aa8f8e7-a3d1-47ee-a598-73323ff847d9 service nova] Releasing lock "refresh_cache-888c3717-57c7-4c58-84ef-c0349a6a9735" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:46:49 user nova-compute[75373]: DEBUG os_brick.utils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e29d27-6292-417e-a14c-0389b048da88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d59fb35-cf61-471e-b2db-9ff8a6a97c27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fa54c-86a2-41e4-bb8f-79ac09f20028]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b21c67-98b4-4a75-80f4-d19d13210f01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:46:50 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:46:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4812e861-3169-4960-9b81-e7a2225f6ea2]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG os_brick.utils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating existing volume attachment record: 93a80495-668c-41e0-850f-c8829a8c3e1c {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG nova.compute.manager [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:46:51 user nova-compute[75373]: WARNING nova.compute.manager [req-7128d1ef-7f9e-413e-9886-a767a0f787bb req-df9e5ed9-620e-47f2-a530-fd7259709a69 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state building and task_state spawning.
Nov 29 07:46:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:46:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Instance spawned successfully.
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:46:53 user nova-compute[75373]: INFO nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:46:53 user nova-compute[75373]: INFO nova.compute.manager [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Took 6.56 seconds to build instance.
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8c28a072-8b64-4d8b-962e-8d6b16f504fd tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.693s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:46:53 user nova-compute[75373]: WARNING nova.compute.manager [req-0a27c3f1-14e0-4392-b984-3243e13a104a req-3c0c424e-bbb1-4101-9211-9e6c31764a92 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state active and task_state None.
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:46:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:46:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:46:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:46:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Creating image(s)
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Ensure instance console log exists: /opt/stack/data/nova/instances/4c962200-109b-4012-937a-e3f0cc594469/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Start _get_guest_xml network_info=[{"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLxKkbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c962200-109b-4012-937a-e3f0cc594469', 'attached_at': '', 'detached_at': '', 'volume_id': '5485a136-a13f-4f0b-9288-e63098a3ad07', 'serial': '5485a136-a13f-4f0b-9288-e63098a3ad07'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '93a80495-668c-41e0-850f-c8829a8c3e1c', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:46:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLxKkbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:46:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:46:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:46:58 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fe77e-afdd-489b-95b3-d6f8ee94a626]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:46:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b64b629-4aaf-4cf1-b3d6-a74fe8b59d1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07] added
Nov 29 07:46:58 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6907f71b-e7c7-4b1e-a85c-70d8e5e2ae28]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0887709-e9cd-4c3a-8bb0-1eb649c74581]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLxKkbv {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLxKkbv" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec814cf2-a6d9-4b84-9e5c-269c08681f02]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMLxKkbv'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a71adc9-f3ec-4cdc-9355-371ec84595c6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c04c3-74ab-4433-8090-7310aec54598]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:46:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:46:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:46:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:46:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:46:58 user nova-compute[75373]: 
Nov 29 07:46:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dac8df-e0f2-4a4f-a5f3-92b362eaf42f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260]
Nov 29 07:46:59 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260] successful.
Nov 29 07:46:59 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.103660583496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0779763f-5051-4fb2-86a3-6e91b2a5e011]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20007c-2540-4e1d-98fb-6a3094fb272f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)
Nov 29 07:46:59 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)
Nov 29 07:46:59 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.631s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6b7f43-aa13-49fc-ab34-d6b5b1b6b18f]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLxKkbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance b0621c2c-d84a-43dd-a8e9-a2561bea00a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4c962200-109b-4012-937a-e3f0cc594469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 888c3717-57c7-4c58-84ef-c0349a6a9735 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:46:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.681s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1682ms) {'type': 'block', 'scsi_wwn': '26237653666333164', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237653666333164', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620104648',display_name='tempest-TestVolumeBootPattern-server-1620104648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620104648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-6y0b0qq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:46:44Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=4c962200-109b-4012-937a-e3f0cc594469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.objects.instance [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c962200-109b-4012-937a-e3f0cc594469 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:47:00 user nova-compute[75373]:   <uuid>4c962200-109b-4012-937a-e3f0cc594469</uuid>
Nov 29 07:47:00 user nova-compute[75373]:   <name>instance-0000002a</name>
Nov 29 07:47:00 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:47:00 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:47:00 user nova-compute[75373]:   <metadata>
Nov 29 07:47:00 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:47:00 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:47:00 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-server-1620104648</nova:name>
Nov 29 07:47:00 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:46:58</nova:creationTime>
Nov 29 07:47:00 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:47:00 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:47:00 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:47:00 user nova-compute[75373]:       <nova:owner>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 07:47:00 user nova-compute[75373]:       </nova:owner>
Nov 29 07:47:00 user nova-compute[75373]:       <nova:ports>
Nov 29 07:47:00 user nova-compute[75373]:         <nova:port uuid="f09588d4-dbbb-495b-8331-25881e3028a5">
Nov 29 07:47:00 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 07:47:00 user nova-compute[75373]:         </nova:port>
Nov 29 07:47:00 user nova-compute[75373]:       </nova:ports>
Nov 29 07:47:00 user nova-compute[75373]:     </nova:instance>
Nov 29 07:47:00 user nova-compute[75373]:   </metadata>
Nov 29 07:47:00 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:47:00 user nova-compute[75373]:     <system>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="serial">4c962200-109b-4012-937a-e3f0cc594469</entry>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="uuid">4c962200-109b-4012-937a-e3f0cc594469</entry>
Nov 29 07:47:00 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:47:00 user nova-compute[75373]:     </system>
Nov 29 07:47:00 user nova-compute[75373]:   </sysinfo>
Nov 29 07:47:00 user nova-compute[75373]:   <os>
Nov 29 07:47:00 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:47:00 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:47:00 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:47:00 user nova-compute[75373]:   </os>
Nov 29 07:47:00 user nova-compute[75373]:   <features>
Nov 29 07:47:00 user nova-compute[75373]:     <acpi/>
Nov 29 07:47:00 user nova-compute[75373]:     <apic/>
Nov 29 07:47:00 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:47:00 user nova-compute[75373]:   </features>
Nov 29 07:47:00 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:47:00 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:47:00 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:47:00 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:47:00 user nova-compute[75373]:   </clock>
Nov 29 07:47:00 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:47:00 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:47:00 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:47:00 user nova-compute[75373]:   </cpu>
Nov 29 07:47:00 user nova-compute[75373]:   <devices>
Nov 29 07:47:00 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:47:00 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:47:00 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:47:00 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:47:00 user nova-compute[75373]:       <serial>5485a136-a13f-4f0b-9288-e63098a3ad07</serial>
Nov 29 07:47:00 user nova-compute[75373]:     </disk>
Nov 29 07:47:00 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:47:00 user nova-compute[75373]:       <mac address="fa:16:3e:35:0f:87"/>
Nov 29 07:47:00 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:47:00 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:47:00 user nova-compute[75373]:       <target dev="tapf09588d4-db"/>
Nov 29 07:47:00 user nova-compute[75373]:     </interface>
Nov 29 07:47:00 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:47:00 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/4c962200-109b-4012-937a-e3f0cc594469/console.log" append="off"/>
Nov 29 07:47:00 user nova-compute[75373]:     </serial>
Nov 29 07:47:00 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:47:00 user nova-compute[75373]:     <video>
Nov 29 07:47:00 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:47:00 user nova-compute[75373]:     </video>
Nov 29 07:47:00 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:47:00 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:47:00 user nova-compute[75373]:     </rng>
Nov 29 07:47:00 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:47:00 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:47:00 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:47:00 user nova-compute[75373]:     </memballoon>
Nov 29 07:47:00 user nova-compute[75373]:   </devices>
Nov 29 07:47:00 user nova-compute[75373]: </domain>
Nov 29 07:47:00 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620104648',display_name='tempest-TestVolumeBootPattern-server-1620104648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620104648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-6y0b0qq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:46:44Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=4c962200-109b-4012-937a-e3f0cc594469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG os_vif [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e00e694b-7c1a-5894-bea5-7c506015aafc', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf09588d4-db, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf09588d4-db, col_values=(('qos', UUID('8e57e896-e000-461e-b9bb-c5f233f4afad')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf09588d4-db, col_values=(('external_ids', {'iface-id': 'f09588d4-dbbb-495b-8331-25881e3028a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0f:87', 'vm-uuid': '4c962200-109b-4012-937a-e3f0cc594469'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:00 user nova-compute[75373]: INFO os_vif [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db')
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:47:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:35:0f:87, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:47:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] No waiting events found dispatching network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:02 user nova-compute[75373]: WARNING nova.compute.manager [req-a3c82006-26b3-454e-a0f4-20800b536c39 req-fb3ca789-268e-4b60-bb19-62d280d5ab04 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received unexpected event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 for instance with vm_state building and task_state spawning.
Nov 29 07:47:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:47:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Instance spawned successfully.
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:03 user nova-compute[75373]: INFO nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 29 07:47:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:47:04 user nova-compute[75373]: INFO nova.compute.manager [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Took 20.19 seconds to build instance.
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] No waiting events found dispatching network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:04 user nova-compute[75373]: WARNING nova.compute.manager [req-c47ee90c-e924-48b8-9b3b-941931e425e2 req-ebea3bb4-14b4-49be-8315-cc9453c5f609 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received unexpected event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 for instance with vm_state active and task_state None.
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c15a0647-b8a7-4c8d-ba79-27ad7df1b4ff tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.296s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:47:04 user nova-compute[75373]: INFO nova.compute.claims [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Claim successful on node user
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:47:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.policy [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c0de209ddd447e4ac2d88eb0f8d7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee3bece22e748818feced3d5d0074f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:47:04 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Creating image(s)
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "/opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "/opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk 1073741824" returned: 0 in 0.058s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Successfully created port: f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Cannot resize image /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Ensure instance console log exists: /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Successfully updated port: f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-changed-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Refreshing instance network info cache due to event network-changed-f3264900-ec67-41ce-9f62-15cfc6e8d46a. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Instance network_info: |[{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.neutron [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Refreshing network info cache for port f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Start _get_guest_xml network_info=[{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:47:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:47:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1181664898',display_name='tempest-SnapshotDataIntegrityTests-server-1181664898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1181664898',id=44,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeWgqO9AFpegBxosmmVqKY1t0qVIrfKrNzuz6r2l37/UnINr3I1zs086PuKAJdHqzmznO0jf5jHRLH25FjSNzsMWL6sfYFBWjmL1mWsADhJno8QaJCaLgBNI4Q3Ml0Abw==',key_name='tempest-keypair-2010463027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee3bece22e748818feced3d5d0074f5',ramdisk_id='',reservation_id='r-25mlboxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1465368896',owner_user_name='tempest-SnapshotDataIntegrityTests-1465368896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c0de209ddd447e4ac2d88eb0f8d7221',uuid=e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converting VIF {"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'pci_devices' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:47:06 user nova-compute[75373]:   <uuid>e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69</uuid>
Nov 29 07:47:06 user nova-compute[75373]:   <name>instance-0000002c</name>
Nov 29 07:47:06 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:47:06 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:47:06 user nova-compute[75373]:   <metadata>
Nov 29 07:47:06 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:47:06 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1181664898</nova:name>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:47:06</nova:creationTime>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:47:06 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:47:06 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:owner>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:user uuid="8c0de209ddd447e4ac2d88eb0f8d7221">tempest-SnapshotDataIntegrityTests-1465368896-project-member</nova:user>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:project uuid="fee3bece22e748818feced3d5d0074f5">tempest-SnapshotDataIntegrityTests-1465368896</nova:project>
Nov 29 07:47:06 user nova-compute[75373]:       </nova:owner>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:47:06 user nova-compute[75373]:       <nova:ports>
Nov 29 07:47:06 user nova-compute[75373]:         <nova:port uuid="f3264900-ec67-41ce-9f62-15cfc6e8d46a">
Nov 29 07:47:06 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 07:47:06 user nova-compute[75373]:         </nova:port>
Nov 29 07:47:06 user nova-compute[75373]:       </nova:ports>
Nov 29 07:47:06 user nova-compute[75373]:     </nova:instance>
Nov 29 07:47:06 user nova-compute[75373]:   </metadata>
Nov 29 07:47:06 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:47:06 user nova-compute[75373]:     <system>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="serial">e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69</entry>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="uuid">e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69</entry>
Nov 29 07:47:06 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:47:06 user nova-compute[75373]:     </system>
Nov 29 07:47:06 user nova-compute[75373]:   </sysinfo>
Nov 29 07:47:06 user nova-compute[75373]:   <os>
Nov 29 07:47:06 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:47:06 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:47:06 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:47:06 user nova-compute[75373]:   </os>
Nov 29 07:47:06 user nova-compute[75373]:   <features>
Nov 29 07:47:06 user nova-compute[75373]:     <acpi/>
Nov 29 07:47:06 user nova-compute[75373]:     <apic/>
Nov 29 07:47:06 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:47:06 user nova-compute[75373]:   </features>
Nov 29 07:47:06 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:47:06 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:47:06 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:47:06 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:47:06 user nova-compute[75373]:   </clock>
Nov 29 07:47:06 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:47:06 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:47:06 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:47:06 user nova-compute[75373]:   </cpu>
Nov 29 07:47:06 user nova-compute[75373]:   <devices>
Nov 29 07:47:06 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:47:06 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:47:06 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk"/>
Nov 29 07:47:06 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:47:06 user nova-compute[75373]:     </disk>
Nov 29 07:47:06 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:47:06 user nova-compute[75373]:       <mac address="fa:16:3e:fb:b1:91"/>
Nov 29 07:47:06 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:47:06 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:47:06 user nova-compute[75373]:       <target dev="tapf3264900-ec"/>
Nov 29 07:47:06 user nova-compute[75373]:     </interface>
Nov 29 07:47:06 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:47:06 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/console.log" append="off"/>
Nov 29 07:47:06 user nova-compute[75373]:     </serial>
Nov 29 07:47:06 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:47:06 user nova-compute[75373]:     <video>
Nov 29 07:47:06 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:47:06 user nova-compute[75373]:     </video>
Nov 29 07:47:06 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:47:06 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:47:06 user nova-compute[75373]:     </rng>
Nov 29 07:47:06 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:47:06 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:47:06 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:47:06 user nova-compute[75373]:     </memballoon>
Nov 29 07:47:06 user nova-compute[75373]:   </devices>
Nov 29 07:47:06 user nova-compute[75373]: </domain>
Nov 29 07:47:06 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1181664898',display_name='tempest-SnapshotDataIntegrityTests-server-1181664898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1181664898',id=44,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeWgqO9AFpegBxosmmVqKY1t0qVIrfKrNzuz6r2l37/UnINr3I1zs086PuKAJdHqzmznO0jf5jHRLH25FjSNzsMWL6sfYFBWjmL1mWsADhJno8QaJCaLgBNI4Q3Ml0Abw==',key_name='tempest-keypair-2010463027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee3bece22e748818feced3d5d0074f5',ramdisk_id='',reservation_id='r-25mlboxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1465368896',owner_user_name='tempest-SnapshotDataIntegrityTests-1465368896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c0de209ddd447e4ac2d88eb0f8d7221',uuid=e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converting VIF {"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG os_vif [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ab5d06b-07ff-56d6-8cfd-1e7509276233', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3264900-ec, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3264900-ec, col_values=(('qos', UUID('0f9a9568-b2bd-44be-a21b-6bf7b00386e1')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3264900-ec, col_values=(('external_ids', {'iface-id': 'f3264900-ec67-41ce-9f62-15cfc6e8d46a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:b1:91', 'vm-uuid': 'e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:06 user nova-compute[75373]: INFO os_vif [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec')
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:47:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No VIF found with MAC fa:16:3e:fb:b1:91, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:47:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated VIF entry in instance network info cache for port f3264900-ec67-41ce-9f62-15cfc6e8d46a. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:47:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:47:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-553712e0-23ef-4c69-8d8e-4e6c3c35b034 req-cdbb0f1f-bc81-4d2f-9ae6-07442380cbae service nova] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] No waiting events found dispatching network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:08 user nova-compute[75373]: WARNING nova.compute.manager [req-9c1f3769-6322-42ae-8559-7c24ecf5313d req-3bf6f29f-54bf-4de8-a0ee-ccd571e7bd11 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received unexpected event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a for instance with vm_state building and task_state spawning.
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:47:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Instance spawned successfully.
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] No waiting events found dispatching network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:10 user nova-compute[75373]: WARNING nova.compute.manager [req-fa0fe355-9895-49c0-9b5e-5b7d57c291b6 req-78f856ae-2a3d-4ffa-8914-95a3d4cbb120 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received unexpected event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a for instance with vm_state building and task_state spawning.
Nov 29 07:47:10 user nova-compute[75373]: INFO nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 29 07:47:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:47:10 user nova-compute[75373]: INFO nova.compute.manager [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Took 6.33 seconds to build instance.
Nov 29 07:47:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9e55bac4-36fc-4514-a7a8-526e80437e25 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.428s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:24 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:39 user nova-compute[75373]: INFO nova.compute.manager [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Terminating instance
Nov 29 07:47:39 user nova-compute[75373]: DEBUG nova.compute.manager [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-unplugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] No waiting events found dispatching network-vif-unplugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-66bf507f-41f5-43c8-8523-4f4e72c5b51a req-d958c301-74c7-450a-a797-0fd8b4cd7c3d service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-unplugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Instance destroyed successfully.
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.objects.instance [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lazy-loading 'resources' on Instance uuid b0621c2c-d84a-43dd-a8e9-a2561bea00a8 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:45:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721019479',display_name='tempest-VolumesActionsTest-instance-721019479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721019479',id=41,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:45:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94757d2dab4b41a9806300d87e6769b3',ramdisk_id='',reservation_id='r-wk08hzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1261554137',owner_user_name='tempest-VolumesActionsTest-1261554137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:45:49Z,user_data=None,user_id='fbd11ce2cf2d44dfb93698957345af64',uuid=b0621c2c-d84a-43dd-a8e9-a2561bea00a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converting VIF {"id": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "address": "fa:16:3e:eb:d3:87", "network": {"id": "ab58262c-359c-416b-9d66-ae5dcfe8c2d6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1936027513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94757d2dab4b41a9806300d87e6769b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ab3a247-88", "ovs_interfaceid": "1ab3a247-88f9-46c4-a56d-13a618afbe7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG os_vif [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ab3a247-88, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8bc24c9-d43f-4295-87ce-4ee99b891dbd) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:40 user nova-compute[75373]: INFO os_vif [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:d3:87,bridge_name='br-int',has_traffic_filtering=True,id=1ab3a247-88f9-46c4-a56d-13a618afbe7f,network=Network(ab58262c-359c-416b-9d66-ae5dcfe8c2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ab3a247-88')
Nov 29 07:47:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Deleting instance files /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8_del
Nov 29 07:47:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Deletion of /opt/stack/data/nova/instances/b0621c2c-d84a-43dd-a8e9-a2561bea00a8_del complete
Nov 29 07:47:40 user nova-compute[75373]: INFO nova.compute.manager [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:47:40 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Took 0.41 seconds to deallocate network for instance.
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:41 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:47:41 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:47:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:41 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Deleted allocations for instance b0621c2c-d84a-43dd-a8e9-a2561bea00a8
Nov 29 07:47:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-5120e21a-6c57-43bb-ae58-33721aabfeeb tempest-VolumesActionsTest-1261554137 tempest-VolumesActionsTest-1261554137-project-member] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.586s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] Acquiring lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:42 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] Lock "b0621c2c-d84a-43dd-a8e9-a2561bea00a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] No waiting events found dispatching network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:47:42 user nova-compute[75373]: WARNING nova.compute.manager [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received unexpected event network-vif-plugged-1ab3a247-88f9-46c4-a56d-13a618afbe7f for instance with vm_state deleted and task_state None.
Nov 29 07:47:42 user nova-compute[75373]: DEBUG nova.compute.manager [req-2534a1ce-e55c-462b-8726-26f9c355b2d9 req-c651f81f-2ba0-4fc9-baa4-7af35a263544 service nova] [instance: b0621c2c-d84a-43dd-a8e9-a2561bea00a8] Received event network-vif-deleted-1ab3a247-88f9-46c4-a56d-13a618afbe7f {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:47:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:47:47 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid 4c962200-109b-4012-937a-e3f0cc594469 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:47:48 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating instance_info_cache with network_info: [{"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:47:48 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-4c962200-109b-4012-937a-e3f0cc594469" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:47:48 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:47:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 4c962200-109b-4012-937a-e3f0cc594469 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid 888c3717-57c7-4c58-84ef-c0349a6a9735 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Triggering sync for uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4c962200-109b-4012-937a-e3f0cc594469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "4c962200-109b-4012-937a-e3f0cc594469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:47:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:47:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:47:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:47:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.072723388671875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:47:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 4c962200-109b-4012-937a-e3f0cc594469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 888c3717-57c7-4c58-84ef-c0349a6a9735 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:48:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:15 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:35 user nova-compute[75373]: INFO nova.compute.manager [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Terminating instance
Nov 29 07:48:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-unplugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] No waiting events found dispatching network-vif-unplugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-e9563bc2-a32e-491c-a820-ed5df69951b5 req-2cfc439e-149b-4c8c-b557-7aac7fdd2d2a service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-unplugged-f09588d4-dbbb-495b-8331-25881e3028a5 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:48:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Instance destroyed successfully.
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.objects.instance [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid 4c962200-109b-4012-937a-e3f0cc594469 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620104648',display_name='tempest-TestVolumeBootPattern-server-1620104648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620104648',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-6y0b0qq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:47:04Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=4c962200-109b-4012-937a-e3f0cc594469,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "f09588d4-dbbb-495b-8331-25881e3028a5", "address": "fa:16:3e:35:0f:87", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09588d4-db", "ovs_interfaceid": "f09588d4-dbbb-495b-8331-25881e3028a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_vif [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf09588d4-db, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e57e896-e000-461e-b9bb-c5f233f4afad) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:36 user nova-compute[75373]: INFO os_vif [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:0f:87,bridge_name='br-int',has_traffic_filtering=True,id=f09588d4-dbbb-495b-8331-25881e3028a5,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf09588d4-db')
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLxKkbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:48:36 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e78af-1ca1-4e15-a4c6-308c493e300e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:48:36 user nova-compute[75373]: No targets found.
Nov 29 07:48:36 user nova-compute[75373]: iSNS:
Nov 29 07:48:36 user nova-compute[75373]: No targets found.
Nov 29 07:48:36 user nova-compute[75373]: STATIC:
Nov 29 07:48:36 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07
Nov 29 07:48:36 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:48:36 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:48:36 user nova-compute[75373]: FIRMWARE:
Nov 29 07:48:36 user nova-compute[75373]: No targets found.
Nov 29 07:48:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:48:36 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:48:36 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511aa89-716b-4e74-aff3-7aff8335e324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[112fd338-180f-4be4-8556-758d16183fa7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)
Nov 29 07:48:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 (non-flash)
Nov 29 07:48:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0449480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76d7b5-8dde-413a-9fa0-36d7a49ee899]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e3916-0f6c-40d3-95c6-1d84729eafba]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[029d75e8-218d-48b3-992e-15d46d579398]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e258cbd-0e22-4e32-a613-9f6395633bf1]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26237653666333164', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f67db2ed', '/dev/disk/by-id/scsi-1SCST_BIOf67db2ed-b7e6f31d0a1212d9') {{(pid=86370) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f45b8bc-075c-492b-91a4-9b66d7a72fa1]: (4, None) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc256d2-4243-49a9-944c-197c3cab6983]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d2bc77-e31b-4ec1-ad6e-3a27a4c1c017]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260]
Nov 29 07:48:36 user nova-compute[75373]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07, portal: 172.16.0.220,3260] successful.
Nov 29 07:48:36 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5485a136-a13f-4f0b-9288-e63098a3ad07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c178c503-3a24-4f61-9a3a-985c3e5ebdba]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (309ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:48:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Deleting instance files /opt/stack/data/nova/instances/4c962200-109b-4012-937a-e3f0cc594469_del
Nov 29 07:48:36 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Deletion of /opt/stack/data/nova/instances/4c962200-109b-4012-937a-e3f0cc594469_del complete
Nov 29 07:48:36 user nova-compute[75373]: INFO nova.compute.manager [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 07:48:36 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:48:36 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:48:37 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Took 0.70 seconds to deallocate network for instance.
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-8e958bbb-30c6-43dd-822d-7fc5e2d0dd13 req-d7524ac2-c52a-4192-a10b-6b1347c65bc3 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-deleted-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:37 user nova-compute[75373]: INFO nova.compute.manager [req-8e958bbb-30c6-43dd-822d-7fc5e2d0dd13 req-d7524ac2-c52a-4192-a10b-6b1347c65bc3 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Neutron deleted interface f09588d4-dbbb-495b-8331-25881e3028a5; detaching it from the instance and deleting it from the info cache
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.network.neutron [req-8e958bbb-30c6-43dd-822d-7fc5e2d0dd13 req-d7524ac2-c52a-4192-a10b-6b1347c65bc3 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-8e958bbb-30c6-43dd-822d-7fc5e2d0dd13 req-d7524ac2-c52a-4192-a10b-6b1347c65bc3 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Detach interface failed, port_id=f09588d4-dbbb-495b-8331-25881e3028a5, reason: Instance 4c962200-109b-4012-937a-e3f0cc594469 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:37 user nova-compute[75373]: INFO nova.compute.manager [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Terminating instance
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Acquiring lock "4c962200-109b-4012-937a-e3f0cc594469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Lock "4c962200-109b-4012-937a-e3f0cc594469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] No waiting events found dispatching network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:37 user nova-compute[75373]: WARNING nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Received unexpected event network-vif-plugged-f09588d4-dbbb-495b-8331-25881e3028a5 for instance with vm_state active and task_state deleting.
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:37 user nova-compute[75373]: DEBUG nova.compute.manager [req-eb77825f-f5f4-4294-a89c-168b7f8ff825 req-e0eb8dc0-16b3-4ece-b7f5-c716399e6526 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.compute.manager [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.compute.manager [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 4c962200-109b-4012-937a-e3f0cc594469] Deleting volume: 5485a136-a13f-4f0b-9288-e63098a3ad07 {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Instance destroyed successfully.
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.objects.instance [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lazy-loading 'resources' on Instance uuid 888c3717-57c7-4c58-84ef-c0349a6a9735 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:46:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-290773893',display_name='tempest-VolumesActionsTest-instance-290773893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-290773893',id=43,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-0mr1dxji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:46:53Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=888c3717-57c7-4c58-84ef-c0349a6a9735,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "address": "fa:16:3e:f0:e4:97", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d5bb5a-1f", "ovs_interfaceid": "46d5bb5a-1fb3-43ae-b579-e16abfc9b751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG os_vif [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46d5bb5a-1f, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dfcf7c5-f6d7-4760-abd7-9fb4d931589a) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: INFO os_vif [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e4:97,bridge_name='br-int',has_traffic_filtering=True,id=46d5bb5a-1fb3-43ae-b579-e16abfc9b751,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d5bb5a-1f')
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Deleting instance files /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735_del
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Deletion of /opt/stack/data/nova/instances/888c3717-57c7-4c58-84ef-c0349a6a9735_del complete
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.compute.manager [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 07:48:38 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance 4c962200-109b-4012-937a-e3f0cc594469
Nov 29 07:48:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-6daea35e-6e65-41d4-9e81-668d24fd479c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "4c962200-109b-4012-937a-e3f0cc594469" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:38 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:48:38 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Took 0.62 seconds to deallocate network for instance.
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Deleted allocations for instance 888c3717-57c7-4c58-84ef-c0349a6a9735
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-7461ac73-3a1f-4155-885f-4ef477b2ba93 req-2689c699-0cba-4ffa-86cf-84522de12cfe service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-deleted-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c0812bc8-0489-46e7-ae6a-d293b7c36988 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:39 user nova-compute[75373]: WARNING nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state deleted and task_state None.
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:39 user nova-compute[75373]: WARNING nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state deleted and task_state None.
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:39 user nova-compute[75373]: WARNING nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state deleted and task_state None.
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:39 user nova-compute[75373]: WARNING nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-unplugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state deleted and task_state None.
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Acquiring lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] Lock "888c3717-57c7-4c58-84ef-c0349a6a9735-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] No waiting events found dispatching network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:48:39 user nova-compute[75373]: WARNING nova.compute.manager [req-dc83cbed-d426-4d0f-8b49-7a23f5c0f186 req-08dcf794-9601-43f7-8c97-1f8cb979e166 service nova] [instance: 888c3717-57c7-4c58-84ef-c0349a6a9735] Received unexpected event network-vif-plugged-46d5bb5a-1fb3-43ae-b579-e16abfc9b751 for instance with vm_state deleted and task_state None.
Nov 29 07:48:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:48:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:49 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:48:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:48:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:48:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:48:50 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:48:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:48:50 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:48:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:48:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-changed-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Refreshing instance network info cache due to event network-changed-f3264900-ec67-41ce-9f62-15cfc6e8d46a. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Refreshing network info cache for port f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated VIF entry in instance network info cache for port f3264900-ec67-41ce-9f62-15cfc6e8d46a. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:48:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c4c20db1-c438-4686-8577-8837bf911659 req-68a9d720-5ed4-4638-8862-b5d2f3f801d5 service nova] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:48:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:57 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:48:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:48:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.098613739013672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:48:59 user nova-compute[75373]: INFO nova.compute.manager [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attaching volume 9a9fb309-c29b-451d-8f7e-e0df6ba7a235 to /dev/vdb
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.utils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a6b5b-c9d0-4c2f-b77e-df8d7ddf4711]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166ea3c-c7f9-4ba9-8187-3f3af8790d5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae4933-8920-41fe-9b07-e2e239f5a8eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda89431-58bd-418c-be26-3ec472393aae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:48:59 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa8387-40f6-4174-b596-91fc1a32f944]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG os_brick.utils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating existing volume attachment record: 81cae323-4a18-4141-be04-e0d2c8b0601d {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:48:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKnWfECt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:49:06 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:49:06 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:49:06 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189e711-55e8-4e16-b201-855f32075ddb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:49:06 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086088d-5c18-426e-91ae-4128c71c1b65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235] added
Nov 29 07:49:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c501ef-0faf-4ccb-9d38-583b952ccd4b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9387bd-b01d-4982-a45c-1ecb11845699]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKnWfECt {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZKnWfECt" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4677433a-06df-41d7-9914-96dd0a3f1957]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZKnWfECt'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df5df23-bafa-4b44-87ae-a583b7671247]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7ce69e-c351-4d3e-a822-51d25b9fdc57]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:49:06 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:49:06 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:49:06 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:49:06 user nova-compute[75373]: 
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb7fea3-eb85-4977-8694-c5fe3afcbbc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260]
Nov 29 07:49:06 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260] successful.
Nov 29 07:49:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[df98e90f-2318-4863-9199-cd620e057793]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fcb16f-01bd-4db7-8941-8a1b000eecfd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)
Nov 29 07:49:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)
Nov 29 07:49:06 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecefdc88-a20d-48ac-92f0-20c0b8a93739]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:49:06 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKnWfECt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:49:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:49:07 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23365363437616364', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:49:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365363437616364', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:49:07 user nova-compute[75373]: DEBUG nova.objects.instance [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:49:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:49:07 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:49:07 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:49:07 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:49:07 user nova-compute[75373]:   <serial>9a9fb309-c29b-451d-8f7e-e0df6ba7a235</serial>
Nov 29 07:49:07 user nova-compute[75373]: </disk>
Nov 29 07:49:07 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No VIF found with MAC fa:16:3e:fb:b1:91, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f49f1363-b9f7-4a47-87b5-72c898ae2d57 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.900s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:23 user nova-compute[75373]: INFO nova.compute.manager [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Detaching volume 9a9fb309-c29b-451d-8f7e-e0df6ba7a235
Nov 29 07:49:23 user nova-compute[75373]: INFO nova.virt.block_device [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attempting to driver detach volume 9a9fb309-c29b-451d-8f7e-e0df6ba7a235 from mountpoint /dev/vdb
Nov 29 07:49:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Attempting to detach device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:49:23 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:49:23 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:49:23 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:49:23 user nova-compute[75373]:   <serial>9a9fb309-c29b-451d-8f7e-e0df6ba7a235</serial>
Nov 29 07:49:23 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:49:23 user nova-compute[75373]: </disk>
Nov 29 07:49:23 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:49:23 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config.
Nov 29 07:49:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:49:23 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:49:23 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:49:23 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:49:23 user nova-compute[75373]:   <serial>9a9fb309-c29b-451d-8f7e-e0df6ba7a235</serial>
Nov 29 07:49:23 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:49:23 user nova-compute[75373]: </disk>
Nov 29 07:49:23 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:49:23 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:49:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:49:29 user nova-compute[75373]: INFO nova.compute.claims [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Claim successful on node user
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:49:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.policy [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a82031ebcb0f49b39da9053f414c41be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8720623ac15948c4b55f8185aeb213b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:49:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Creating image(s)
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "/opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "/opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "/opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.182s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193,backing_fmt=raw /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk 1073741824" returned: 0 in 0.052s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Successfully created port: c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Cannot resize image /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Ensure instance console log exists: /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Successfully updated port: c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquired lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-changed-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Refreshing instance network info cache due to event network-changed-c3947daa-cb4a-44ae-958f-dd39ec943e0b. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] Acquiring lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updating instance_info_cache with network_info: [{"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Releasing lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Instance network_info: |[{"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] Acquired lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Refreshing network info cache for port c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Start _get_guest_xml network_info=[{"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'f913c500-a725-42d4-bfc8-b62422a3c4fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:49:31 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:49:31 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:16:58Z,direct_url=<?>,disk_format='qcow2',id=f913c500-a725-42d4-bfc8-b62422a3c4fa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d532832723cc4fbf8d2f03455186491c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:16:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785635275',display_name='tempest-VolumesActionsTest-instance-785635275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785635275',id=45,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-4ifdsc5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:49:30Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=c57141e9-9a36-4f01-97bc-965bc89072f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lazy-loading 'pci_devices' on Instance uuid c57141e9-9a36-4f01-97bc-965bc89072f9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:49:31 user nova-compute[75373]:   <uuid>c57141e9-9a36-4f01-97bc-965bc89072f9</uuid>
Nov 29 07:49:31 user nova-compute[75373]:   <name>instance-0000002d</name>
Nov 29 07:49:31 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:49:31 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:49:31 user nova-compute[75373]:   <metadata>
Nov 29 07:49:31 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:49:31 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:name>tempest-VolumesActionsTest-instance-785635275</nova:name>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:49:31</nova:creationTime>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:49:31 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:49:31 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:owner>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:user uuid="a82031ebcb0f49b39da9053f414c41be">tempest-VolumesActionsTest-388158060-project-member</nova:user>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:project uuid="8720623ac15948c4b55f8185aeb213b1">tempest-VolumesActionsTest-388158060</nova:project>
Nov 29 07:49:31 user nova-compute[75373]:       </nova:owner>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:root type="image" uuid="f913c500-a725-42d4-bfc8-b62422a3c4fa"/>
Nov 29 07:49:31 user nova-compute[75373]:       <nova:ports>
Nov 29 07:49:31 user nova-compute[75373]:         <nova:port uuid="c3947daa-cb4a-44ae-958f-dd39ec943e0b">
Nov 29 07:49:31 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 07:49:31 user nova-compute[75373]:         </nova:port>
Nov 29 07:49:31 user nova-compute[75373]:       </nova:ports>
Nov 29 07:49:31 user nova-compute[75373]:     </nova:instance>
Nov 29 07:49:31 user nova-compute[75373]:   </metadata>
Nov 29 07:49:31 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:49:31 user nova-compute[75373]:     <system>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="serial">c57141e9-9a36-4f01-97bc-965bc89072f9</entry>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="uuid">c57141e9-9a36-4f01-97bc-965bc89072f9</entry>
Nov 29 07:49:31 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:49:31 user nova-compute[75373]:     </system>
Nov 29 07:49:31 user nova-compute[75373]:   </sysinfo>
Nov 29 07:49:31 user nova-compute[75373]:   <os>
Nov 29 07:49:31 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:49:31 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:49:31 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:49:31 user nova-compute[75373]:   </os>
Nov 29 07:49:31 user nova-compute[75373]:   <features>
Nov 29 07:49:31 user nova-compute[75373]:     <acpi/>
Nov 29 07:49:31 user nova-compute[75373]:     <apic/>
Nov 29 07:49:31 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:49:31 user nova-compute[75373]:   </features>
Nov 29 07:49:31 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:49:31 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:49:31 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:49:31 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:49:31 user nova-compute[75373]:   </clock>
Nov 29 07:49:31 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:49:31 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:49:31 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:49:31 user nova-compute[75373]:   </cpu>
Nov 29 07:49:31 user nova-compute[75373]:   <devices>
Nov 29 07:49:31 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:49:31 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:49:31 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk"/>
Nov 29 07:49:31 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:49:31 user nova-compute[75373]:     </disk>
Nov 29 07:49:31 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:49:31 user nova-compute[75373]:       <mac address="fa:16:3e:69:0c:c9"/>
Nov 29 07:49:31 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:49:31 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:49:31 user nova-compute[75373]:       <target dev="tapc3947daa-cb"/>
Nov 29 07:49:31 user nova-compute[75373]:     </interface>
Nov 29 07:49:31 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:49:31 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/console.log" append="off"/>
Nov 29 07:49:31 user nova-compute[75373]:     </serial>
Nov 29 07:49:31 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:49:31 user nova-compute[75373]:     <video>
Nov 29 07:49:31 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:49:31 user nova-compute[75373]:     </video>
Nov 29 07:49:31 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:49:31 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:49:31 user nova-compute[75373]:     </rng>
Nov 29 07:49:31 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:49:31 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:49:31 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:49:31 user nova-compute[75373]:     </memballoon>
Nov 29 07:49:31 user nova-compute[75373]:   </devices>
Nov 29 07:49:31 user nova-compute[75373]: </domain>
Nov 29 07:49:31 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785635275',display_name='tempest-VolumesActionsTest-instance-785635275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785635275',id=45,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-4ifdsc5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:49:30Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=c57141e9-9a36-4f01-97bc-965bc89072f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG os_vif [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '125ebbbe-e4ce-5ec4-be22-5e56bf9433c2', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3947daa-cb, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3947daa-cb, col_values=(('qos', UUID('a2485faf-72c7-471f-a46e-2616d9ac857c')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3947daa-cb, col_values=(('external_ids', {'iface-id': 'c3947daa-cb4a-44ae-958f-dd39ec943e0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:0c:c9', 'vm-uuid': 'c57141e9-9a36-4f01-97bc-965bc89072f9'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:31 user nova-compute[75373]: INFO os_vif [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb')
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] No VIF found with MAC fa:16:3e:69:0c:c9, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updated VIF entry in instance network info cache for port c3947daa-cb4a-44ae-958f-dd39ec943e0b. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:49:31 user nova-compute[75373]: DEBUG nova.network.neutron [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updating instance_info_cache with network_info: [{"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:49:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6fae965f-e4fc-4a63-9e30-bb0a854e4431 req-9869ca7a-b001-4a72-9ba8-d4b4dee163f4 service nova] Releasing lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] No waiting events found dispatching network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:49:33 user nova-compute[75373]: WARNING nova.compute.manager [req-599ffcf2-0738-45cf-9455-a945ddab2c80 req-5073ae09-5448-4c6e-b1b0-334caffc1e4e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received unexpected event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b for instance with vm_state building and task_state spawning.
Nov 29 07:49:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:49:35 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Instance spawned successfully.
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.compute.manager [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] No waiting events found dispatching network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:49:35 user nova-compute[75373]: WARNING nova.compute.manager [req-487137c7-d900-4b4e-b3a4-1eccaf40aa15 req-e21e7a20-9588-458f-a2bd-9b59494d8a5a service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received unexpected event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b for instance with vm_state building and task_state spawning.
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:49:36 user nova-compute[75373]: INFO nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 29 07:49:36 user nova-compute[75373]: DEBUG nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:49:36 user nova-compute[75373]: INFO nova.compute.manager [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Took 6.75 seconds to build instance.
Nov 29 07:49:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0df2691a-c4b3-4bc8-97b2-31e49d40b025 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.841s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:43 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 is timed out.
Nov 29 07:49:43 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config.
Nov 29 07:49:43 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZKnWfECt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:49:43 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa811d-66ee-4f8a-bd58-f010ebc266ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:49:43 user nova-compute[75373]: No targets found.
Nov 29 07:49:43 user nova-compute[75373]: iSNS:
Nov 29 07:49:43 user nova-compute[75373]: No targets found.
Nov 29 07:49:43 user nova-compute[75373]: STATIC:
Nov 29 07:49:43 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235
Nov 29 07:49:43 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:49:43 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:49:43 user nova-compute[75373]: FIRMWARE:
Nov 29 07:49:43 user nova-compute[75373]: No targets found.
Nov 29 07:49:43 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:49:43 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:49:43 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e1682f-f6af-436c-88cc-25fda90a2e8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0f19d9-7794-4587-97b1-d3042c8a5383]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)
Nov 29 07:49:43 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 (non-flash)
Nov 29 07:49:43 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae03c5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0ae209-c618-413b-84c9-5b4dcb6d5136]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7adeb53-bcce-4586-8e6a-5840034108a3]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:43 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf4f49-7fe0-463e-a299-3137307d9092]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4a70f5-e72a-462d-8345-8ee6ada46e2c]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[21248477-1c00-4ebf-b602-7d906c1bc756]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a913f1-d397-43ba-8eef-1829d2e1f8f2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260]
Nov 29 07:49:44 user nova-compute[75373]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235, portal: 172.16.0.220,3260] successful.
Nov 29 07:49:44 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a9fb309-c29b-451d-8f7e-e0df6ba7a235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb125f7-dcaf-4b3e-b424-88b2963da691]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== disconnect_volume: return (307ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:49:44 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:49:45 user nova-compute[75373]: DEBUG nova.objects.instance [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:49:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-49751a03-e86c-46eb-9c63-a7633d37ab76 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:49:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:49:47 user nova-compute[75373]: INFO nova.compute.claims [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Claim successful on node user
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:49:47 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:49:47 user nova-compute[75373]: DEBUG nova.policy [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:49:47 user nova-compute[75373]: INFO nova.virt.block_device [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Booting with volume e2536bef-3976-4356-80c7-dd8dad6f24d2 at /dev/vda
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.utils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[665ed1aa-5a58-4fa2-a675-cdf3f8549611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca6d99-f710-49b4-b680-62d211292419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7ce44-bc9d-4b35-9499-9c703189fae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a721b-4056-40e7-9aa6-03edb512cdf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:49:48 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:49:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c5c465-d72a-4d8e-8951-1b2981f979eb]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG os_brick.utils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating existing volume attachment record: 70733cc1-cf99-4375-81df-3249f41ea695 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:49:48 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Successfully created port: 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Successfully updated port: 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-changed-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.compute.manager [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Refreshing instance network info cache due to event network-changed-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] Acquiring lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.network.neutron [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Instance network_info: |[{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] Acquired lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:49:49 user nova-compute[75373]: DEBUG nova.network.neutron [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Refreshing network info cache for port 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:49:50 user nova-compute[75373]: DEBUG nova.network.neutron [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updated VIF entry in instance network info cache for port 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:49:50 user nova-compute[75373]: DEBUG nova.network.neutron [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:49:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-558d8e00-fca1-4064-81af-a132290f0b2b req-29cce259-1a1c-488e-8ce3-57c666467ed5 service nova] Releasing lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:49:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:49:52 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:49:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:49:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:49:55 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:49:58 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Creating image(s)
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Ensure instance console log exists: /opt/stack/data/nova/instances/706e4af9-3d27-47c7-b5bc-42c75d9d3e90/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Start _get_guest_xml network_info=[{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQTRVXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '706e4af9-3d27-47c7-b5bc-42c75d9d3e90', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2536bef-3976-4356-80c7-dd8dad6f24d2', 'serial': 'e2536bef-3976-4356-80c7-dd8dad6f24d2'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '70733cc1-cf99-4375-81df-3249f41ea695', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:49:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:49:58 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQTRVXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:49:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:49:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:49:58 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bf0483-566f-4aa9-ba9e-850fa5587658]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:49:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e829b296-f0b3-48a2-ba94-e3a148eb00e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2] added
Nov 29 07:49:58 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[67acdb67-5f8d-4b2e-9880-a164a666fd15]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a28a382-7c11-468e-8c6d-e3da97b82aa9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZQTRVXk {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZQTRVXk" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05853f-31fd-42e3-8b24-e8cd9a7f7174]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZQTRVXk'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd8da4e-ba96-42e9-a7bd-599d3fcfe4ea]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[55be34e6-070b-4f5c-8fa1-9d819ef1b22f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:49:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:49:58 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:49:58 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:49:58 user nova-compute[75373]: 
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a838a8-0fc6-4dbb-b20c-f73925c18248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260]
Nov 29 07:49:58 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260] successful.
Nov 29 07:49:58 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[28925063-0a57-4fa4-b493-d5886bc9ab85]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a687e3f3-751b-450c-8cc1-b614569dbdfa]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:49:58 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:49:58 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae63f41-87ed-4a0c-ac85-429292a350c6]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:49:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQTRVXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26134386337396361', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134386337396361', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-904054929',display_name='tempest-TestVolumeBootPattern-volume-backed-server-904054929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-904054929',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrd7HF5XuCLsC0KmEAaS7XKjgRlMWMnMeTojO46Ee3CaU/Ru+4NKcG9/pPxKSkbY2QbKCktHKjSnh/U0pO2olkwhduHzKELXnxMy1YPfk8j2sjyV3MCqh6rPdvcY3MsoA==',key_name='tempest-keypair-426774359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8x8yz3w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=706e4af9-3d27-47c7-b5bc-42c75d9d3e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:49:59 user nova-compute[75373]:   <uuid>706e4af9-3d27-47c7-b5bc-42c75d9d3e90</uuid>
Nov 29 07:49:59 user nova-compute[75373]:   <name>instance-0000002e</name>
Nov 29 07:49:59 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:49:59 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:49:59 user nova-compute[75373]:   <metadata>
Nov 29 07:49:59 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:49:59 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:49:59 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-904054929</nova:name>
Nov 29 07:49:59 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:49:58</nova:creationTime>
Nov 29 07:49:59 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:49:59 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:49:59 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:49:59 user nova-compute[75373]:       <nova:owner>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 07:49:59 user nova-compute[75373]:       </nova:owner>
Nov 29 07:49:59 user nova-compute[75373]:       <nova:ports>
Nov 29 07:49:59 user nova-compute[75373]:         <nova:port uuid="73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3">
Nov 29 07:49:59 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 07:49:59 user nova-compute[75373]:         </nova:port>
Nov 29 07:49:59 user nova-compute[75373]:       </nova:ports>
Nov 29 07:49:59 user nova-compute[75373]:     </nova:instance>
Nov 29 07:49:59 user nova-compute[75373]:   </metadata>
Nov 29 07:49:59 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:49:59 user nova-compute[75373]:     <system>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="serial">706e4af9-3d27-47c7-b5bc-42c75d9d3e90</entry>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="uuid">706e4af9-3d27-47c7-b5bc-42c75d9d3e90</entry>
Nov 29 07:49:59 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:49:59 user nova-compute[75373]:     </system>
Nov 29 07:49:59 user nova-compute[75373]:   </sysinfo>
Nov 29 07:49:59 user nova-compute[75373]:   <os>
Nov 29 07:49:59 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:49:59 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:49:59 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:49:59 user nova-compute[75373]:   </os>
Nov 29 07:49:59 user nova-compute[75373]:   <features>
Nov 29 07:49:59 user nova-compute[75373]:     <acpi/>
Nov 29 07:49:59 user nova-compute[75373]:     <apic/>
Nov 29 07:49:59 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:49:59 user nova-compute[75373]:   </features>
Nov 29 07:49:59 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:49:59 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:49:59 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:49:59 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:49:59 user nova-compute[75373]:   </clock>
Nov 29 07:49:59 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:49:59 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:49:59 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:49:59 user nova-compute[75373]:   </cpu>
Nov 29 07:49:59 user nova-compute[75373]:   <devices>
Nov 29 07:49:59 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:49:59 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:49:59 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:49:59 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:49:59 user nova-compute[75373]:       <serial>e2536bef-3976-4356-80c7-dd8dad6f24d2</serial>
Nov 29 07:49:59 user nova-compute[75373]:     </disk>
Nov 29 07:49:59 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:49:59 user nova-compute[75373]:       <mac address="fa:16:3e:35:36:45"/>
Nov 29 07:49:59 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:49:59 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:49:59 user nova-compute[75373]:       <target dev="tap73cb8520-b6"/>
Nov 29 07:49:59 user nova-compute[75373]:     </interface>
Nov 29 07:49:59 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:49:59 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/706e4af9-3d27-47c7-b5bc-42c75d9d3e90/console.log" append="off"/>
Nov 29 07:49:59 user nova-compute[75373]:     </serial>
Nov 29 07:49:59 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:49:59 user nova-compute[75373]:     <video>
Nov 29 07:49:59 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:49:59 user nova-compute[75373]:     </video>
Nov 29 07:49:59 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:49:59 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:49:59 user nova-compute[75373]:     </rng>
Nov 29 07:49:59 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:49:59 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:49:59 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:49:59 user nova-compute[75373]:     </memballoon>
Nov 29 07:49:59 user nova-compute[75373]:   </devices>
Nov 29 07:49:59 user nova-compute[75373]: </domain>
Nov 29 07:49:59 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-904054929',display_name='tempest-TestVolumeBootPattern-volume-backed-server-904054929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-904054929',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrd7HF5XuCLsC0KmEAaS7XKjgRlMWMnMeTojO46Ee3CaU/Ru+4NKcG9/pPxKSkbY2QbKCktHKjSnh/U0pO2olkwhduHzKELXnxMy1YPfk8j2sjyV3MCqh6rPdvcY3MsoA==',key_name='tempest-keypair-426774359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8x8yz3w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=706e4af9-3d27-47c7-b5bc-42c75d9d3e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG os_vif [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4902249-d944-5a44-9629-2d0919bf6cef', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73cb8520-b6, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73cb8520-b6, col_values=(('qos', UUID('0877ee9e-1689-4790-9612-7f96f3d3c67d')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73cb8520-b6, col_values=(('external_ids', {'iface-id': '73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:36:45', 'vm-uuid': '706e4af9-3d27-47c7-b5bc-42c75d9d3e90'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:49:59 user nova-compute[75373]: INFO os_vif [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6')
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:49:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:35:36:45, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:50:01 user nova-compute[75373]: WARNING nova.compute.manager [req-345a620b-870a-4d58-bda2-aa7bd3904f66 req-9808e765-b1b9-4e62-b095-59966c5ededd service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state building and task_state spawning.
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:50:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:50:03 user nova-compute[75373]: WARNING nova.compute.manager [req-a2744a55-c175-41eb-952b-da9164a7b057 req-569f49c7-b60c-4eac-aae2-bea5c4fa9a63 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state building and task_state spawning.
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:50:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:50:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.057960510253906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Instance spawned successfully.
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance c57141e9-9a36-4f01-97bc-965bc89072f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:50:03 user nova-compute[75373]: INFO nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:50:03 user nova-compute[75373]: INFO nova.compute.manager [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Took 16.32 seconds to build instance.
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cc5763bf-f70b-474a-b5e7-e27ca7938acb tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.427s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:50:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:16 user nova-compute[75373]: INFO nova.compute.manager [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attaching volume 00344172-a9ca-4efe-bd51-40660333c903 to /dev/vdb
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f55794-d5aa-4fa2-8de1-6fde80c6936a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0542949c-b657-4551-b1b9-b15528ab4f46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d34fab-8585-4df4-8028-d6b4b08abc10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[50994008-5e84-4fa4-8d21-5c509c2b1722]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:50:16 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:50:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b7907b-9c53-491f-b42c-2ec9b83de442]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG os_brick.utils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:50:16 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating existing volume attachment record: 7f2f15ea-2646-4d1d-9c54-ba1f03f195fe {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:50:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpKASNQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:50:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:50:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:50:24 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796c516-c2c5-4ae5-8db7-df40fac56e65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:50:24 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cac05c-4cfc-4930-a245-6715f043148a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903] added
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e683fd-a151-4c56-944b-2e591f45051a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae4c8c-53ed-48b6-8dc7-88766f83a8a4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpKASNQL {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpKASNQL" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df0b83c-7df6-425d-98cf-0c6858ff9d7d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpKASNQL'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[99824d7b-d84a-4e01-a6f5-f09e57b0275c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642e23e-5bb8-41c5-a035-9ac574c5ee0e]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3226158b-227f-4327-be9d-bc80447ec889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260]
Nov 29 07:50:24 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260] successful.
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b1126-5129-4bd9-a300-6665f9f00254]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679b0eb-681a-44ad-96c5-8daff1bec90a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)
Nov 29 07:50:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb3fa0-617f-4328-9200-dfdeb5178012]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpKASNQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:50:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23739343865303134', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739343865303134', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:50:25 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:50:25 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:50:25 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:50:25 user nova-compute[75373]:   <serial>00344172-a9ca-4efe-bd51-40660333c903</serial>
Nov 29 07:50:25 user nova-compute[75373]: </disk>
Nov 29 07:50:25 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No VIF found with MAC fa:16:3e:fb:b1:91, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:50:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-33f51641-6738-443a-ada7-c1bcb78974eb tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.410s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:50:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:50:28 user nova-compute[75373]: INFO nova.compute.manager [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Detaching volume 00344172-a9ca-4efe-bd51-40660333c903
Nov 29 07:50:28 user nova-compute[75373]: INFO nova.virt.block_device [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attempting to driver detach volume 00344172-a9ca-4efe-bd51-40660333c903 from mountpoint /dev/vdb
Nov 29 07:50:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Attempting to detach device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:50:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:50:28 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:50:28 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:50:28 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:50:28 user nova-compute[75373]:   <serial>00344172-a9ca-4efe-bd51-40660333c903</serial>
Nov 29 07:50:28 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:50:28 user nova-compute[75373]: </disk>
Nov 29 07:50:28 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:50:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config.
Nov 29 07:50:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:50:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:50:28 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:50:28 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:50:28 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:50:28 user nova-compute[75373]:   <serial>00344172-a9ca-4efe-bd51-40660333c903</serial>
Nov 29 07:50:28 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:50:28 user nova-compute[75373]: </disk>
Nov 29 07:50:28 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:50:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:50:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:50:48 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 is timed out.
Nov 29 07:50:48 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config.
Nov 29 07:50:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpKASNQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:50:48 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c8d97-e94a-4527-9e95-716cb7ee7afe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:50:48 user nova-compute[75373]: No targets found.
Nov 29 07:50:48 user nova-compute[75373]: iSNS:
Nov 29 07:50:48 user nova-compute[75373]: No targets found.
Nov 29 07:50:48 user nova-compute[75373]: STATIC:
Nov 29 07:50:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903
Nov 29 07:50:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:50:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:50:48 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2
Nov 29 07:50:48 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:50:48 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:50:48 user nova-compute[75373]: FIRMWARE:
Nov 29 07:50:48 user nova-compute[75373]: No targets found.
Nov 29 07:50:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:50:48 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:50:48 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d96550-ad6f-414a-9919-35ec984e6866]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[39361836-9125-4a83-b101-a3dd007c833c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:48 user nova-compute[75373]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)
Nov 29 07:50:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:50:48 user nova-compute[75373]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 (non-flash)
Nov 29 07:50:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b002d9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8c8f8-2d48-40cc-be74-e00e0ccc5d25]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c1c4cb-f1b0-44bb-83dc-c46c16022380]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e3f119-52cc-4ee6-893d-9ef8d1e21768]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[87970318-0976-4edc-a4c0-0a4e61759948]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5729e018-8672-4fd6-a438-ed9fef100328]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d64d41-5ac9-44c7-90b8-eb04765280fa]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260]
Nov 29 07:50:48 user nova-compute[75373]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903, portal: 172.16.0.220,3260] successful.
Nov 29 07:50:48 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00344172-a9ca-4efe-bd51-40660333c903 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a6a13-1a4c-4a4d-b5d3-1257e3420d12]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== disconnect_volume: return (313ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:50:48 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d75db6dd-f96b-4054-a7e1-c974cd0410b0 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:50:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:52 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:52 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updating instance_info_cache with network_info: [{"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-c57141e9-9a36-4f01-97bc-965bc89072f9" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:50:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:50:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:50:57 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:50:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:51:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:51:01 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:51:01 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.05585479736328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance c57141e9-9a36-4f01-97bc-965bc89072f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:51:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:51:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:17 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:19 user nova-compute[75373]: INFO nova.compute.manager [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Terminating instance
Nov 29 07:51:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-unplugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] No waiting events found dispatching network-vif-unplugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:51:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-6b53d3a8-0540-464a-ad39-4755fbba6608 req-ab735b75-2def-43bf-a1b5-81156154547e service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-unplugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Instance destroyed successfully.
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.objects.instance [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lazy-loading 'resources' on Instance uuid c57141e9-9a36-4f01-97bc-965bc89072f9 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785635275',display_name='tempest-VolumesActionsTest-instance-785635275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-785635275',id=45,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8720623ac15948c4b55f8185aeb213b1',ramdisk_id='',reservation_id='r-4ifdsc5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-388158060',owner_user_name='tempest-VolumesActionsTest-388158060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:49:36Z,user_data=None,user_id='a82031ebcb0f49b39da9053f414c41be',uuid=c57141e9-9a36-4f01-97bc-965bc89072f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converting VIF {"id": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "address": "fa:16:3e:69:0c:c9", "network": {"id": "9f3ee6c4-f079-4153-8cb1-3b9f6432944f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-320415437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8720623ac15948c4b55f8185aeb213b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3947daa-cb", "ovs_interfaceid": "c3947daa-cb4a-44ae-958f-dd39ec943e0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG os_vif [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3947daa-cb, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2485faf-72c7-471f-a46e-2616d9ac857c) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:20 user nova-compute[75373]: INFO os_vif [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:0c:c9,bridge_name='br-int',has_traffic_filtering=True,id=c3947daa-cb4a-44ae-958f-dd39ec943e0b,network=Network(9f3ee6c4-f079-4153-8cb1-3b9f6432944f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3947daa-cb')
Nov 29 07:51:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Deleting instance files /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9_del
Nov 29 07:51:20 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Deletion of /opt/stack/data/nova/instances/c57141e9-9a36-4f01-97bc-965bc89072f9_del complete
Nov 29 07:51:20 user nova-compute[75373]: INFO nova.compute.manager [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 07:51:20 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:51:20 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Took 0.42 seconds to deallocate network for instance.
Nov 29 07:51:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-dca6741a-d323-4318-823b-71e22d32ecc1 req-12cc17dc-f558-46f4-9bd6-80b596cd7dfb service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-deleted-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:21 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Deleted allocations for instance c57141e9-9a36-4f01-97bc-965bc89072f9
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:21 user nova-compute[75373]: INFO nova.compute.manager [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attaching volume ea0af263-48db-4f94-a22c-7e54e1f5c28f to /dev/vdb
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-03477ad5-2fca-43dd-8e9b-d736ad68c289 tempest-VolumesActionsTest-388158060 tempest-VolumesActionsTest-388158060-project-member] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.551s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.utils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5005194-e115-4203-a505-5411490e468f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a4a61-89d4-4fc4-b839-f3c4d40c659a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd1226d-245c-4aef-ae77-50f93001f037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37988d4-e021-4f8d-a06c-eb41f8df5aa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:51:21 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:51:21 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac3566-00fb-4afa-8536-699e0e65e0c4]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG os_brick.utils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:51:21 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating existing volume attachment record: e75b9ebc-56dd-44e0-ad5c-6523a2b50152 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:51:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:51:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] Acquiring lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] Lock "c57141e9-9a36-4f01-97bc-965bc89072f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] No waiting events found dispatching network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:51:22 user nova-compute[75373]: WARNING nova.compute.manager [req-0d30d34c-30a5-44bf-915d-0ee345ebc152 req-ef0e0e07-065c-4d97-bdec-5e413d110da2 service nova] [instance: c57141e9-9a36-4f01-97bc-965bc89072f9] Received unexpected event network-vif-plugged-c3947daa-cb4a-44ae-958f-dd39ec943e0b for instance with vm_state deleted and task_state None.
Nov 29 07:51:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLDTIKFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:51:28 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:51:28 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:51:28 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea8a53-829e-4361-bee9-f555e941234b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:51:28 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78e976f-2aba-438a-a76e-218cf3e669cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f] added
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd8415-1816-4520-9c15-71d21649baa8]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e7b4e-6cb6-4783-b63e-4ed889f0907e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLDTIKFz {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HLDTIKFz" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4499fb-8c99-4f27-b642-8c5b734b551b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HLDTIKFz'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ca48a4-6a42-4266-bce2-b0d7d80edb90]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fea07f-c164-481e-ad15-34c6f7cc9545]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cc4661-8b94-47f0-ac27-2d477a232d22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260]
Nov 29 07:51:28 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260] successful.
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb85afed-df54-4af1-9c2b-0c091e101737]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a332ce-4ccb-4bed-978e-f8920587f61f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:28 user nova-compute[75373]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:28 user nova-compute[75373]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)
Nov 29 07:51:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa5feb6-80db-40c6-b0ee-55e75e53f2a3]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:51:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLDTIKFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:51:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:51:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23139663331343533', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:51:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139663331343533', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:51:29 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:51:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:51:29 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:51:29 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:51:29 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:51:29 user nova-compute[75373]:   <serial>ea0af263-48db-4f94-a22c-7e54e1f5c28f</serial>
Nov 29 07:51:29 user nova-compute[75373]: </disk>
Nov 29 07:51:29 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:51:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:51:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:51:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No VIF found with MAC fa:16:3e:fb:b1:91, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:51:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b8ad733b-7ab2-4d02-bd68-6f7393ed0a74 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.032s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:32 user nova-compute[75373]: INFO nova.compute.manager [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Detaching volume ea0af263-48db-4f94-a22c-7e54e1f5c28f
Nov 29 07:51:32 user nova-compute[75373]: INFO nova.virt.block_device [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attempting to driver detach volume ea0af263-48db-4f94-a22c-7e54e1f5c28f from mountpoint /dev/vdb
Nov 29 07:51:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Attempting to detach device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:51:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:51:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:51:32 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:51:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:51:32 user nova-compute[75373]:   <serial>ea0af263-48db-4f94-a22c-7e54e1f5c28f</serial>
Nov 29 07:51:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:51:32 user nova-compute[75373]: </disk>
Nov 29 07:51:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:51:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config.
Nov 29 07:51:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:51:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:51:32 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:51:32 user nova-compute[75373]:   <source dev="/dev/sdc"/>
Nov 29 07:51:32 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:51:32 user nova-compute[75373]:   <serial>ea0af263-48db-4f94-a22c-7e54e1f5c28f</serial>
Nov 29 07:51:32 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:51:32 user nova-compute[75373]: </disk>
Nov 29 07:51:32 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:51:33 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:51:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-changed-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:51:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Refreshing instance network info cache due to event network-changed-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:51:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] Acquiring lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:51:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] Acquired lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:51:38 user nova-compute[75373]: DEBUG nova.network.neutron [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Refreshing network info cache for port 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:51:39 user nova-compute[75373]: DEBUG nova.network.neutron [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updated VIF entry in instance network info cache for port 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:51:39 user nova-compute[75373]: DEBUG nova.network.neutron [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:51:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-15c43338-0522-467b-90ba-2c2bd61fff8d req-551ea0ef-ceff-475c-9922-ee81a9a68a58 service nova] Releasing lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:51:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:51:45 user nova-compute[75373]: INFO nova.compute.claims [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Claim successful on node user
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:51:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:51:45 user nova-compute[75373]: INFO nova.virt.block_device [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Booting with volume snapshot 06978df3-cdc6-4a8d-9524-5bd9cf773317 at /dev/vda
Nov 29 07:51:45 user nova-compute[75373]: DEBUG nova.policy [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:51:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:46 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Successfully created port: ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Successfully updated port: ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.compute.manager [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-changed-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.compute.manager [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Refreshing instance network info cache due to event network-changed-ced891e7-d9bb-4e5b-a26a-2b2806e58b03. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] Acquiring lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating instance_info_cache with network_info: [{"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Instance network_info: |[{"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] Acquired lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Refreshing network info cache for port ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updated VIF entry in instance network info cache for port ced891e7-d9bb-4e5b-a26a-2b2806e58b03. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG nova.network.neutron [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating instance_info_cache with network_info: [{"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:51:47 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1bb7609e-f929-4124-8523-fcee7fce0e45 req-495d62d2-9344-474f-8fcf-8f8891b65a37 service nova] Releasing lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:51:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.utils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[90429760-cbfd-4b8d-900a-e2ebfdc7458b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bf76d-ebde-4f90-a4f4-4b23289194e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a3900-4a57-4a7d-bddb-3e79e0c2067d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eaf441-17a7-4c1e-a7de-19e4614fd4f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:51:51 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:51:51 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[39584257-3515-4bba-b602-caff06dd6900]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG os_brick.utils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:51:51 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating existing volume attachment record: 33de894b-ee84-46b2-897d-3ae847510911 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:51:53 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 is timed out.
Nov 29 07:51:53 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config.
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HLDTIKFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:51:53 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2906b21e-528a-4384-8b04-83bee1fe4414]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:51:53 user nova-compute[75373]: No targets found.
Nov 29 07:51:53 user nova-compute[75373]: iSNS:
Nov 29 07:51:53 user nova-compute[75373]: No targets found.
Nov 29 07:51:53 user nova-compute[75373]: STATIC:
Nov 29 07:51:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f
Nov 29 07:51:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:51:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:51:53 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2
Nov 29 07:51:53 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:51:53 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:51:53 user nova-compute[75373]: FIRMWARE:
Nov 29 07:51:53 user nova-compute[75373]: No targets found.
Nov 29 07:51:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:51:53 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:51:53 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e26b7-954e-4b91-b0d6-8011dd27455d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1263b2-12d5-4afa-a567-18514e065fcb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:53 user nova-compute[75373]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)
Nov 29 07:51:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:51:53 user nova-compute[75373]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f (non-flash)
Nov 29 07:51:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0448af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c0d59-a631-4b19-85f3-7002e66a4e9a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566fccb-bd5f-48cc-8a31-eaaf8700e94c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d023c-139b-4efc-80b6-46ca4ab3f5c9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2018b1-2db9-435d-8389-70d2d2a6910d]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cecea1-5280-4c81-92b5-2241a2de1b84]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea7789-d9a3-42e3-a883-cc9554b2065c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260]
Nov 29 07:51:53 user nova-compute[75373]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f, portal: 172.16.0.220,3260] successful.
Nov 29 07:51:53 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea0af263-48db-4f94-a22c-7e54e1f5c28f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67425a-f9ed-47e3-92c7-0c8bc2ed48db]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== disconnect_volume: return (256ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:51:53 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:51:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:51:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:51:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:51:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:51:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:51:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d20e6cd6-195c-4266-b2d6-9762e3d63b6c tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.193s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:52:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:52:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Creating image(s)
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Ensure instance console log exists: /opt/stack/data/nova/instances/08950117-77c9-4be6-8ab4-7f740147a51c/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Start _get_guest_xml network_info=[{"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T07:51:40Z,direct_url=<?>,disk_format='qcow2',id=58042e7f-b2fc-4001-8118-7c0e9e016780,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-326390839',owner='b9f92519c816456f9f7acab9ceed7842',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T07:51:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAuftpYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08950117-77c9-4be6-8ab4-7f740147a51c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e38e3259-b6e2-475b-bee9-5be19c45ec90', 'serial': 'e38e3259-b6e2-475b-bee9-5be19c45ec90'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '33de894b-ee84-46b2-897d-3ae847510911', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:52:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:52:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T07:51:40Z,direct_url=<?>,disk_format='qcow2',id=58042e7f-b2fc-4001-8118-7c0e9e016780,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-326390839',owner='b9f92519c816456f9f7acab9ceed7842',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T07:51:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAuftpYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:52:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:52:02 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:52:02 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26c895-5bec-4682-91fd-64f601097b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:52:02 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae591b97-dabb-492b-bdfc-1fe999f7f2bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90] added
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:52:02 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.081836700439453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6cf20e-d070-4d6a-b303-7911e36cb515]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[866f717a-d152-4933-922c-d248c87d5058]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAuftpYJ {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zAuftpYJ" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ec756-7d89-43e0-88b9-7de7ab4028f5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zAuftpYJ'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8bad02-e5bd-463c-9e3f-f91dc3961f19]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[316864cb-b453-4049-935b-d7b7d77b860f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a6d8b-772b-41a8-af87-2a961a906b33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260]
Nov 29 07:52:02 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260] successful.
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5316d0df-7862-4b84-9903-9b536d758648]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 08950117-77c9-4be6-8ab4-7f740147a51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3fdb7d-eab0-451e-a436-523102db188d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:02 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.601s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b81227a-eadb-4ff3-abc8-baa65c0a9b3c]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAuftpYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:52:02 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.633s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1635ms) {'type': 'block', 'scsi_wwn': '23239323939336361', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239323939336361', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1402589593',id=47,image_ref='58042e7f-b2fc-4001-8118-7c0e9e016780',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1812ksWUS3VnbNSk6Y4sQHAZlaSbkw2ex/dcXOcHAWLgv+6PIKt8898JTUhZCdxDk8Irlxwpk7J1KmoXcBI1T1jmgygh4CNFWIbjP4gxvYxa2KH1My7Ca+jOkbsHgmEA==',key_name='tempest-keypair-1938112641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8e5yhsz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-305019745',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=08950117-77c9-4be6-8ab4-7f740147a51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid 08950117-77c9-4be6-8ab4-7f740147a51c {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:52:03 user nova-compute[75373]:   <uuid>08950117-77c9-4be6-8ab4-7f740147a51c</uuid>
Nov 29 07:52:03 user nova-compute[75373]:   <name>instance-0000002f</name>
Nov 29 07:52:03 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:52:03 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:52:03 user nova-compute[75373]:   <metadata>
Nov 29 07:52:03 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:52:03 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1402589593</nova:name>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:52:02</nova:creationTime>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:52:03 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:52:03 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:owner>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 07:52:03 user nova-compute[75373]:       </nova:owner>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:root type="image" uuid="58042e7f-b2fc-4001-8118-7c0e9e016780"/>
Nov 29 07:52:03 user nova-compute[75373]:       <nova:ports>
Nov 29 07:52:03 user nova-compute[75373]:         <nova:port uuid="ced891e7-d9bb-4e5b-a26a-2b2806e58b03">
Nov 29 07:52:03 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 07:52:03 user nova-compute[75373]:         </nova:port>
Nov 29 07:52:03 user nova-compute[75373]:       </nova:ports>
Nov 29 07:52:03 user nova-compute[75373]:     </nova:instance>
Nov 29 07:52:03 user nova-compute[75373]:   </metadata>
Nov 29 07:52:03 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:52:03 user nova-compute[75373]:     <system>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="serial">08950117-77c9-4be6-8ab4-7f740147a51c</entry>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="uuid">08950117-77c9-4be6-8ab4-7f740147a51c</entry>
Nov 29 07:52:03 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:52:03 user nova-compute[75373]:     </system>
Nov 29 07:52:03 user nova-compute[75373]:   </sysinfo>
Nov 29 07:52:03 user nova-compute[75373]:   <os>
Nov 29 07:52:03 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:52:03 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:52:03 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:52:03 user nova-compute[75373]:   </os>
Nov 29 07:52:03 user nova-compute[75373]:   <features>
Nov 29 07:52:03 user nova-compute[75373]:     <acpi/>
Nov 29 07:52:03 user nova-compute[75373]:     <apic/>
Nov 29 07:52:03 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:52:03 user nova-compute[75373]:   </features>
Nov 29 07:52:03 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:52:03 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:52:03 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:52:03 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:52:03 user nova-compute[75373]:   </clock>
Nov 29 07:52:03 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:52:03 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:52:03 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:52:03 user nova-compute[75373]:   </cpu>
Nov 29 07:52:03 user nova-compute[75373]:   <devices>
Nov 29 07:52:03 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:52:03 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:52:03 user nova-compute[75373]:       <source dev="/dev/sdc"/>
Nov 29 07:52:03 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:52:03 user nova-compute[75373]:       <serial>e38e3259-b6e2-475b-bee9-5be19c45ec90</serial>
Nov 29 07:52:03 user nova-compute[75373]:     </disk>
Nov 29 07:52:03 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:52:03 user nova-compute[75373]:       <mac address="fa:16:3e:f3:26:03"/>
Nov 29 07:52:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:52:03 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:52:03 user nova-compute[75373]:       <target dev="tapced891e7-d9"/>
Nov 29 07:52:03 user nova-compute[75373]:     </interface>
Nov 29 07:52:03 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:52:03 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/08950117-77c9-4be6-8ab4-7f740147a51c/console.log" append="off"/>
Nov 29 07:52:03 user nova-compute[75373]:     </serial>
Nov 29 07:52:03 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:52:03 user nova-compute[75373]:     <video>
Nov 29 07:52:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:52:03 user nova-compute[75373]:     </video>
Nov 29 07:52:03 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:52:03 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:52:03 user nova-compute[75373]:     </rng>
Nov 29 07:52:03 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:52:03 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:52:03 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:52:03 user nova-compute[75373]:     </memballoon>
Nov 29 07:52:03 user nova-compute[75373]:   </devices>
Nov 29 07:52:03 user nova-compute[75373]: </domain>
Nov 29 07:52:03 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1402589593',id=47,image_ref='58042e7f-b2fc-4001-8118-7c0e9e016780',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1812ksWUS3VnbNSk6Y4sQHAZlaSbkw2ex/dcXOcHAWLgv+6PIKt8898JTUhZCdxDk8Irlxwpk7J1KmoXcBI1T1jmgygh4CNFWIbjP4gxvYxa2KH1My7Ca+jOkbsHgmEA==',key_name='tempest-keypair-1938112641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8e5yhsz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-305019745',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=08950117-77c9-4be6-8ab4-7f740147a51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG os_vif [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b08e2317-8c20-5318-8923-92e79dd9511c', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced891e7-d9, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapced891e7-d9, col_values=(('qos', UUID('35a82983-a5e4-469c-91c7-aef9a1eb3e88')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapced891e7-d9, col_values=(('external_ids', {'iface-id': 'ced891e7-d9bb-4e5b-a26a-2b2806e58b03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:26:03', 'vm-uuid': '08950117-77c9-4be6-8ab4-7f740147a51c'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:52:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:03 user nova-compute[75373]: INFO os_vif [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9')
Nov 29 07:52:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:52:04 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:f3:26:03, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:52:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:05 user nova-compute[75373]: DEBUG nova.compute.manager [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] No waiting events found dispatching network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:52:05 user nova-compute[75373]: WARNING nova.compute.manager [req-5fbd0962-3e63-4e56-a278-e1e4d87b9cb9 req-a865e06a-6636-4a6c-98a1-8c40a218e390 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received unexpected event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 for instance with vm_state building and task_state spawning.
Nov 29 07:52:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:52:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Instance spawned successfully.
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:52:07 user nova-compute[75373]: INFO nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:52:07 user nova-compute[75373]: INFO nova.compute.manager [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Took 22.06 seconds to build instance.
Nov 29 07:52:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1769e278-3a8a-4183-851c-68eb3b1fe89e tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.160s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] No waiting events found dispatching network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:52:07 user nova-compute[75373]: WARNING nova.compute.manager [req-f799de74-5424-4383-8c23-b5cb4bf169ac req-54939700-9500-4665-aaa4-292d70d5c069 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received unexpected event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 for instance with vm_state active and task_state None.
Nov 29 07:52:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:52:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:25 user nova-compute[75373]: INFO nova.compute.manager [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attaching volume 976d87af-de9e-47ae-8034-a1682ac6d396 to /dev/vdb
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.utils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa808391-eb53-479f-8e81-c5256940cb76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1220fd2-2c67-4566-a678-8d1057dcc628]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd18cb2-a6fd-478f-8ad8-98091a7cac35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[145ab76a-cf80-45d3-bfbb-dd0fc3011a37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:52:26 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:52:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf26a0-609d-4f9b-9093-6ecdc0da271c]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG os_brick.utils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating existing volume attachment record: 707b93e4-ea72-4323-8c6a-609970732579 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:52:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HErXsvCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:52:35 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:52:35 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:52:35 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b06f30-e3bd-4d1f-a83f-025e66c99fad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:52:35 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6531d3-be54-426c-8980-e73235a7364b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396] added
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c26d48-bd0f-4319-809d-d720e04da879]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[875dfa0e-df49-472d-af1c-95bfa39cb086]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HErXsvCh {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HErXsvCh" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5547a54f-6f4a-437c-ac05-839ad36a0f9d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HErXsvCh'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[702976cc-dc81-4edf-9450-381260e858c5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd3384a-b53b-4ba4-a3bf-ea9efac0bdd5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[560248bc-ae03-478c-af1f-4b3ba719612d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260]
Nov 29 07:52:35 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260] successful.
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906c46c-71c6-4b37-a9f3-7ea530210761]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ce1a8b-8d85-4349-b380-8d014ed88458]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1495a8f-412e-47d2-9211-2cd2d8dbbada (non-flash)
Nov 29 07:52:35 user nova-compute[75373]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)
Nov 29 07:52:35 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7430d6-99a4-40ab-ad71-95fc170bc193]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:52:35 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HErXsvCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23632393430326165', 'path': '/dev/sde'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632393430326165', 'path': '/dev/sde'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG nova.objects.instance [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:52:36 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:52:36 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:52:36 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:52:36 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:52:36 user nova-compute[75373]:   <serial>976d87af-de9e-47ae-8034-a1682ac6d396</serial>
Nov 29 07:52:36 user nova-compute[75373]: </disk>
Nov 29 07:52:36 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:52:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:52:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:52:37 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] No VIF found with MAC fa:16:3e:fb:b1:91, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:52:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-0242242b-314f-446b-90aa-b9cde89f7181 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.499s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:52:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:52:39 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:52:39 user nova-compute[75373]: INFO nova.compute.manager [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Detaching volume 976d87af-de9e-47ae-8034-a1682ac6d396
Nov 29 07:52:39 user nova-compute[75373]: INFO nova.virt.block_device [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Attempting to driver detach volume 976d87af-de9e-47ae-8034-a1682ac6d396 from mountpoint /dev/vdb
Nov 29 07:52:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Attempting to detach device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:52:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:52:39 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:52:39 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:52:39 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:52:39 user nova-compute[75373]:   <serial>976d87af-de9e-47ae-8034-a1682ac6d396</serial>
Nov 29 07:52:39 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:52:39 user nova-compute[75373]: </disk>
Nov 29 07:52:39 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:52:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the persistent domain config.
Nov 29 07:52:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:52:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:52:39 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:52:39 user nova-compute[75373]:   <source dev="/dev/sde"/>
Nov 29 07:52:39 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:52:39 user nova-compute[75373]:   <serial>976d87af-de9e-47ae-8034-a1682ac6d396</serial>
Nov 29 07:52:39 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 07:52:39 user nova-compute[75373]: </disk>
Nov 29 07:52:39 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:52:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:52:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:52:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [{"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:52:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-706e4af9-3d27-47c7-b5bc-42c75d9d3e90" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:52:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:52:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:58 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:52:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:00 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 is timed out.
Nov 29 07:53:00 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully detached device vdb from instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 from the live domain config.
Nov 29 07:53:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HErXsvCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:53:00 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f576e2-30b8-47c3-a052-d76eebec2916]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:53:00 user nova-compute[75373]: No targets found.
Nov 29 07:53:00 user nova-compute[75373]: iSNS:
Nov 29 07:53:00 user nova-compute[75373]: No targets found.
Nov 29 07:53:00 user nova-compute[75373]: STATIC:
Nov 29 07:53:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396
Nov 29 07:53:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:53:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:53:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2
Nov 29 07:53:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:53:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:53:00 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90
Nov 29 07:53:00 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:53:00 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:53:00 user nova-compute[75373]: FIRMWARE:
Nov 29 07:53:00 user nova-compute[75373]: No targets found.
Nov 29 07:53:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:53:00 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:53:00 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[56db64f7-9dee-4bc6-950d-8dadca68a1e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ebfdc5-22ec-4e2b-b747-6eb6eeca0fc0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 (non-flash)
Nov 29 07:53:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae02cf640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396'): ({'sde'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Removing single pathed devices sde {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b733bbc-d144-4789-a058-b7e0e1650dda]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[64833607-aba3-4ad1-bcc9-bcf06922cf89]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Flushing IO for device /dev/sde {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[48417c1e-250f-49f5-8931-ce78d786cc9a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a2cf53-9779-4729-b337-d4873ebc1f58]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] SCSI volumes sde have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b240e-ac23-456f-9c35-50c9109ecda0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c2383-21b7-4f92-8ab8-d421a2f613e9]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260]
Nov 29 07:53:00 user nova-compute[75373]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396, portal: 172.16.0.220,3260] successful.
Nov 29 07:53:00 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:976d87af-de9e-47ae-8034-a1682ac6d396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e4052-82e6-4dab-bd0b-5ee509dff04f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] <== disconnect_volume: return (315ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:00 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:53:00 user nova-compute[75373]: INFO nova.compute.claims [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Claim successful on node user
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.objects.instance [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'flavor' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-fb65b427-cd39-4ded-ac10-b741cae51a00 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:53:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.policy [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '163bc599637749ff819b798c5efe7867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef78e97ba874f0cb154f8f941708330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:53:01 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Creating image(s)
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Successfully created port: 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.part --force-share --output=json" returned: 0 in 0.226s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.virt.images [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] fa4a6c33-0f01-41d7-9a67-e7f5c76c5419 was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:53:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.part /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.part /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.converted" returned: 0 in 0.116s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.901s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Successfully updated port: 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json" returned: 0 in 0.168s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing instance network info cache due to event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1,backing_fmt=raw /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1,backing_fmt=raw /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk 1073741824" returned: 0 in 0.050s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "3851fa0eb600fdbde7e06b35b7aad7666dc5ace1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.network.neutron [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance network_info: |[{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.network.neutron [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:53:02 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Cannot resize image /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Ensure instance console log exists: /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start _get_guest_xml network_info=[{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:52:58Z,direct_url=<?>,disk_format='qcow2',id=fa4a6c33-0f01-41d7-9a67-e7f5c76c5419,min_disk=0,min_ram=0,name='tempest-scenario-img--571334603',owner='4ef78e97ba874f0cb154f8f941708330',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:53:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'fa4a6c33-0f01-41d7-9a67-e7f5c76c5419'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:53:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:53:03 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:52:58Z,direct_url=<?>,disk_format='qcow2',id=fa4a6c33-0f01-41d7-9a67-e7f5c76c5419,min_disk=0,min_ram=0,name='tempest-scenario-img--571334603',owner='4ef78e97ba874f0cb154f8f941708330',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:53:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:53:01Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'pci_devices' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:53:03 user nova-compute[75373]:   <uuid>e5588c49-75a4-44fb-b092-fe89bb9f3b27</uuid>
Nov 29 07:53:03 user nova-compute[75373]:   <name>instance-00000030</name>
Nov 29 07:53:03 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:53:03 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:53:03 user nova-compute[75373]:   <metadata>
Nov 29 07:53:03 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:53:03 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:name>tempest-TestMinimumBasicScenario-server-2087347124</nova:name>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:53:03</nova:creationTime>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:53:03 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:53:03 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:owner>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:user uuid="163bc599637749ff819b798c5efe7867">tempest-TestMinimumBasicScenario-1027187955-project-member</nova:user>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:project uuid="4ef78e97ba874f0cb154f8f941708330">tempest-TestMinimumBasicScenario-1027187955</nova:project>
Nov 29 07:53:03 user nova-compute[75373]:       </nova:owner>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:root type="image" uuid="fa4a6c33-0f01-41d7-9a67-e7f5c76c5419"/>
Nov 29 07:53:03 user nova-compute[75373]:       <nova:ports>
Nov 29 07:53:03 user nova-compute[75373]:         <nova:port uuid="0717663c-3893-442c-8284-c4d4ed7f8620">
Nov 29 07:53:03 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:53:03 user nova-compute[75373]:         </nova:port>
Nov 29 07:53:03 user nova-compute[75373]:       </nova:ports>
Nov 29 07:53:03 user nova-compute[75373]:     </nova:instance>
Nov 29 07:53:03 user nova-compute[75373]:   </metadata>
Nov 29 07:53:03 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:53:03 user nova-compute[75373]:     <system>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="serial">e5588c49-75a4-44fb-b092-fe89bb9f3b27</entry>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="uuid">e5588c49-75a4-44fb-b092-fe89bb9f3b27</entry>
Nov 29 07:53:03 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:53:03 user nova-compute[75373]:     </system>
Nov 29 07:53:03 user nova-compute[75373]:   </sysinfo>
Nov 29 07:53:03 user nova-compute[75373]:   <os>
Nov 29 07:53:03 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:53:03 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:53:03 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:53:03 user nova-compute[75373]:   </os>
Nov 29 07:53:03 user nova-compute[75373]:   <features>
Nov 29 07:53:03 user nova-compute[75373]:     <acpi/>
Nov 29 07:53:03 user nova-compute[75373]:     <apic/>
Nov 29 07:53:03 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:53:03 user nova-compute[75373]:   </features>
Nov 29 07:53:03 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:53:03 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:53:03 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:53:03 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:53:03 user nova-compute[75373]:   </clock>
Nov 29 07:53:03 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:53:03 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:53:03 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:53:03 user nova-compute[75373]:   </cpu>
Nov 29 07:53:03 user nova-compute[75373]:   <devices>
Nov 29 07:53:03 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:53:03 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:53:03 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk"/>
Nov 29 07:53:03 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:53:03 user nova-compute[75373]:     </disk>
Nov 29 07:53:03 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:53:03 user nova-compute[75373]:       <mac address="fa:16:3e:d1:fc:01"/>
Nov 29 07:53:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:53:03 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:53:03 user nova-compute[75373]:       <target dev="tap0717663c-38"/>
Nov 29 07:53:03 user nova-compute[75373]:     </interface>
Nov 29 07:53:03 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:53:03 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/console.log" append="off"/>
Nov 29 07:53:03 user nova-compute[75373]:     </serial>
Nov 29 07:53:03 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:53:03 user nova-compute[75373]:     <video>
Nov 29 07:53:03 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:53:03 user nova-compute[75373]:     </video>
Nov 29 07:53:03 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:53:03 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:53:03 user nova-compute[75373]:     </rng>
Nov 29 07:53:03 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:53:03 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:53:03 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:53:03 user nova-compute[75373]:     </memballoon>
Nov 29 07:53:03 user nova-compute[75373]:   </devices>
Nov 29 07:53:03 user nova-compute[75373]: </domain>
Nov 29 07:53:03 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:53:01Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG os_vif [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3860ce19-9e36-533a-9074-b8e4e373f58f', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0717663c-38, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0717663c-38, col_values=(('qos', UUID('03ab4ea3-6e2e-4c51-8642-5e007d1435e8')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0717663c-38, col_values=(('external_ids', {'iface-id': '0717663c-3893-442c-8284-c4d4ed7f8620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:fc:01', 'vm-uuid': 'e5588c49-75a4-44fb-b092-fe89bb9f3b27'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:03 user nova-compute[75373]: INFO os_vif [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38')
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated VIF entry in instance network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7313c128-ba38-411d-86da-5ad2c78f0d4f req-9f2aa2b3-86b5-41e4-95d4-66481b0a17d2 service nova] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No VIF found with MAC fa:16:3e:d1:fc:01, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:03 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:04 user nova-compute[75373]: WARNING nova.compute.manager [req-409eda3f-49b4-4a89-aa82-d24dd3ea35c2 req-0967c2b2-8355-445f-a08e-c516cebe8851 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state building and task_state spawning.
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:53:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:53:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=25.009334564208984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 08950117-77c9-4be6-8ab4-7f740147a51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:53:06 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance spawned successfully.
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.manager [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:06 user nova-compute[75373]: WARNING nova.compute.manager [req-40706e19-778d-463d-8d99-42fbef73bd93 req-ce780da9-ffa1-45ab-a3f7-1e8e80440bff service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state building and task_state spawning.
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:53:06 user nova-compute[75373]: INFO nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 29 07:53:06 user nova-compute[75373]: DEBUG nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:53:06 user nova-compute[75373]: INFO nova.compute.manager [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Took 6.11 seconds to build instance.
Nov 29 07:53:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-8336eb70-4c99-40ad-b6c7-bfa2406ddec6 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.207s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:53:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:17 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:53:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-changed-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG nova.compute.manager [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Refreshing instance network info cache due to event network-changed-ced891e7-d9bb-4e5b-a26a-2b2806e58b03. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] Acquiring lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] Acquired lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG nova.network.neutron [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Refreshing network info cache for port ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG nova.network.neutron [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updated VIF entry in instance network info cache for port ced891e7-d9bb-4e5b-a26a-2b2806e58b03. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG nova.network.neutron [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating instance_info_cache with network_info: [{"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:36 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-7ae13219-1014-4b1b-b223-0f50cfa4bc84 req-040c5bed-1010-4e76-9c02-dfc69dda4481 service nova] Releasing lock "refresh_cache-08950117-77c9-4be6-8ab4-7f740147a51c" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:37 user nova-compute[75373]: INFO nova.compute.manager [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Terminating instance
Nov 29 07:53:37 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-unplugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] No waiting events found dispatching network-vif-unplugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.compute.manager [req-d50d1987-99c8-4d59-a341-3392dd7fc030 req-8e2d72c6-3162-4489-bdfb-63dd0b8eec64 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-unplugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:53:38 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Instance destroyed successfully.
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.objects.instance [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid 08950117-77c9-4be6-8ab4-7f740147a51c {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1402589593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1402589593',id=47,image_ref='58042e7f-b2fc-4001-8118-7c0e9e016780',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1812ksWUS3VnbNSk6Y4sQHAZlaSbkw2ex/dcXOcHAWLgv+6PIKt8898JTUhZCdxDk8Irlxwpk7J1KmoXcBI1T1jmgygh4CNFWIbjP4gxvYxa2KH1My7Ca+jOkbsHgmEA==',key_name='tempest-keypair-1938112641',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8e5yhsz9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-305019745',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=08950117-77c9-4be6-8ab4-7f740147a51c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "address": "fa:16:3e:f3:26:03", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced891e7-d9", "ovs_interfaceid": "ced891e7-d9bb-4e5b-a26a-2b2806e58b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_vif [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced891e7-d9, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35a82983-a5e4-469c-91c7-aef9a1eb3e88) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:53:38 user nova-compute[75373]: INFO os_vif [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:26:03,bridge_name='br-int',has_traffic_filtering=True,id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced891e7-d9')
Nov 29 07:53:38 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zAuftpYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:53:38 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99d157f-4880-467d-86d9-2900b3935971]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:53:38 user nova-compute[75373]: No targets found.
Nov 29 07:53:38 user nova-compute[75373]: iSNS:
Nov 29 07:53:38 user nova-compute[75373]: No targets found.
Nov 29 07:53:38 user nova-compute[75373]: STATIC:
Nov 29 07:53:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2
Nov 29 07:53:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:53:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:53:38 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90
Nov 29 07:53:38 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:53:38 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:53:38 user nova-compute[75373]: FIRMWARE:
Nov 29 07:53:38 user nova-compute[75373]: No targets found.
Nov 29 07:53:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:53:38 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:53:38 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[20481285-2cd0-4265-b2f8-4169da326eff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff96f7b-9a7c-4ec7-b7ae-96412f31c654]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:53:38 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:53:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:53:38 user nova-compute[75373]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 (non-flash)
Nov 29 07:53:38 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0041b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b6f365-ac7c-4624-8231-70a207535c49]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[636cc24a-2122-40f5-8dd3-064794586ea6]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5004bade-bd8a-4e97-a0ed-54089c3657c6]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b9d6c-a3a6-492c-88b1-27efebf6d0ab]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[47558087-3b9c-4229-b73c-3bac907a8e58]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:38 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98fc7ed-09c7-4188-9a84-538d0926dc7e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260]
Nov 29 07:53:39 user nova-compute[75373]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90, portal: 172.16.0.220,3260] successful.
Nov 29 07:53:39 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e38e3259-b6e2-475b-bee9-5be19c45ec90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[92134b2b-9ce9-4d2b-8d8b-11b7d80e5e6b]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (317ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:53:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Deleting instance files /opt/stack/data/nova/instances/08950117-77c9-4be6-8ab4-7f740147a51c_del
Nov 29 07:53:39 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Deletion of /opt/stack/data/nova/instances/08950117-77c9-4be6-8ab4-7f740147a51c_del complete
Nov 29 07:53:39 user nova-compute[75373]: INFO nova.compute.manager [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 29 07:53:39 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-aca2616e-2ee1-4648-8808-74f745ae5903 req-546d591e-72cb-413d-b507-084654447af6 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-deleted-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:39 user nova-compute[75373]: INFO nova.compute.manager [req-aca2616e-2ee1-4648-8808-74f745ae5903 req-546d591e-72cb-413d-b507-084654447af6 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Neutron deleted interface ced891e7-d9bb-4e5b-a26a-2b2806e58b03; detaching it from the instance and deleting it from the info cache
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.network.neutron [req-aca2616e-2ee1-4648-8808-74f745ae5903 req-546d591e-72cb-413d-b507-084654447af6 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:39 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Took 0.79 seconds to deallocate network for instance.
Nov 29 07:53:39 user nova-compute[75373]: DEBUG nova.compute.manager [req-aca2616e-2ee1-4648-8808-74f745ae5903 req-546d591e-72cb-413d-b507-084654447af6 service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Detach interface failed, port_id=ced891e7-d9bb-4e5b-a26a-2b2806e58b03, reason: Instance 08950117-77c9-4be6-8ab4-7f740147a51c could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] Acquiring lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] Lock "08950117-77c9-4be6-8ab4-7f740147a51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG nova.compute.manager [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] No waiting events found dispatching network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:40 user nova-compute[75373]: WARNING nova.compute.manager [req-3405d931-28c4-45be-bbd5-84f72497c3e0 req-6e09ec09-6322-46a0-9963-09e3b040d0ea service nova] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Received unexpected event network-vif-plugged-ced891e7-d9bb-4e5b-a26a-2b2806e58b03 for instance with vm_state active and task_state deleting.
Nov 29 07:53:40 user nova-compute[75373]: INFO nova.compute.manager [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 07:53:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 08950117-77c9-4be6-8ab4-7f740147a51c] Deleting volume: e38e3259-b6e2-475b-bee9-5be19c45ec90 {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:53:40 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:53:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:41 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance 08950117-77c9-4be6-8ab4-7f740147a51c
Nov 29 07:53:41 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-cf629264-98fc-456a-a061-5672313cd286 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "08950117-77c9-4be6-8ab4-7f740147a51c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.292s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:48 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:53:53 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:53:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [{"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:53:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:53:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:55 user nova-compute[75373]: INFO nova.compute.manager [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Terminating instance
Nov 29 07:53:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-unplugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] No waiting events found dispatching network-vif-unplugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-2707ed27-a4ae-4529-a586-136bb9f62a72 req-42127852-a29e-4191-8a37-3e3bca299b6b service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-unplugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Instance destroyed successfully.
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.objects.instance [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lazy-loading 'resources' on Instance uuid e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:47:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1181664898',display_name='tempest-SnapshotDataIntegrityTests-server-1181664898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1181664898',id=44,image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeWgqO9AFpegBxosmmVqKY1t0qVIrfKrNzuz6r2l37/UnINr3I1zs086PuKAJdHqzmznO0jf5jHRLH25FjSNzsMWL6sfYFBWjmL1mWsADhJno8QaJCaLgBNI4Q3Ml0Abw==',key_name='tempest-keypair-2010463027',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:47:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fee3bece22e748818feced3d5d0074f5',ramdisk_id='',reservation_id='r-25mlboxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f913c500-a725-42d4-bfc8-b62422a3c4fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1465368896',owner_user_name='tempest-SnapshotDataIntegrityTests-1465368896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c0de209ddd447e4ac2d88eb0f8d7221',uuid=e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converting VIF {"id": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "address": "fa:16:3e:fb:b1:91", "network": {"id": "43704475-7762-440b-8c58-9356b8a87d6b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645676494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee3bece22e748818feced3d5d0074f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3264900-ec", "ovs_interfaceid": "f3264900-ec67-41ce-9f62-15cfc6e8d46a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG os_vif [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3264900-ec, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f9a9568-b2bd-44be-a21b-6bf7b00386e1) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:53:56 user nova-compute[75373]: INFO os_vif [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:b1:91,bridge_name='br-int',has_traffic_filtering=True,id=f3264900-ec67-41ce-9f62-15cfc6e8d46a,network=Network(43704475-7762-440b-8c58-9356b8a87d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3264900-ec')
Nov 29 07:53:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Deleting instance files /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69_del
Nov 29 07:53:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Deletion of /opt/stack/data/nova/instances/e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69_del complete
Nov 29 07:53:56 user nova-compute[75373]: INFO nova.compute.manager [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 07:53:56 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:53:56 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:57 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Took 0.98 seconds to deallocate network for instance.
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-5b331f6f-a082-432f-85e3-edf46a809f75 req-b4833a9a-d310-4a86-9c5a-866882bc6fd7 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-deleted-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:57 user nova-compute[75373]: INFO nova.compute.manager [req-5b331f6f-a082-432f-85e3-edf46a809f75 req-b4833a9a-d310-4a86-9c5a-866882bc6fd7 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Neutron deleted interface f3264900-ec67-41ce-9f62-15cfc6e8d46a; detaching it from the instance and deleting it from the info cache
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.network.neutron [req-5b331f6f-a082-432f-85e3-edf46a809f75 req-b4833a9a-d310-4a86-9c5a-866882bc6fd7 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.compute.manager [req-5b331f6f-a082-432f-85e3-edf46a809f75 req-b4833a9a-d310-4a86-9c5a-866882bc6fd7 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Detach interface failed, port_id=f3264900-ec67-41ce-9f62-15cfc6e8d46a, reason: Instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:53:57 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:58 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Deleted allocations for instance e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69
Nov 29 07:53:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-2f39a436-375c-4ca5-b8b3-aa18500f8437 tempest-SnapshotDataIntegrityTests-1465368896 tempest-SnapshotDataIntegrityTests-1465368896-project-member] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] Acquiring lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] Lock "e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:53:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] No waiting events found dispatching network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:53:58 user nova-compute[75373]: WARNING nova.compute.manager [req-cabc4b05-2e33-4475-b7d3-b77f18c58115 req-d87ba680-897a-40c3-bde9-550468bb5580 service nova] [instance: e2bddcd9-79d5-45b8-aa80-9d2e3fd9fd69] Received unexpected event network-vif-plugged-f3264900-ec67-41ce-9f62-15cfc6e8d46a for instance with vm_state deleted and task_state None.
Nov 29 07:53:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:54:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:54:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:54:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.00769805908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:54:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:07 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:54:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:31 user nova-compute[75373]: INFO nova.compute.manager [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Terminating instance
Nov 29 07:54:31 user nova-compute[75373]: DEBUG nova.compute.manager [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:31 user nova-compute[75373]: DEBUG nova.compute.manager [req-b9b852b0-143c-4d9c-9511-2dd69f47454a req-216cf5e3-4a35-4998-84fb-80218a957272 service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Instance destroyed successfully.
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.objects.instance [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-904054929',display_name='tempest-TestVolumeBootPattern-volume-backed-server-904054929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-904054929',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrd7HF5XuCLsC0KmEAaS7XKjgRlMWMnMeTojO46Ee3CaU/Ru+4NKcG9/pPxKSkbY2QbKCktHKjSnh/U0pO2olkwhduHzKELXnxMy1YPfk8j2sjyV3MCqh6rPdvcY3MsoA==',key_name='tempest-keypair-426774359',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:50:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-8x8yz3w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=706e4af9-3d27-47c7-b5bc-42c75d9d3e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "address": "fa:16:3e:35:36:45", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73cb8520-b6", "ovs_interfaceid": "73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_vif [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73cb8520-b6, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0877ee9e-1689-4790-9612-7f96f3d3c67d) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:32 user nova-compute[75373]: INFO os_vif [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:36:45,bridge_name='br-int',has_traffic_filtering=True,id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73cb8520-b6')
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZQTRVXk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:54:32 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa25c48-97a0-4d00-8ace-810131c35390]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:54:32 user nova-compute[75373]: No targets found.
Nov 29 07:54:32 user nova-compute[75373]: iSNS:
Nov 29 07:54:32 user nova-compute[75373]: No targets found.
Nov 29 07:54:32 user nova-compute[75373]: STATIC:
Nov 29 07:54:32 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2
Nov 29 07:54:32 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:54:32 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:54:32 user nova-compute[75373]: FIRMWARE:
Nov 29 07:54:32 user nova-compute[75373]: No targets found.
Nov 29 07:54:32 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:54:32 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:54:32 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3adb6-1bcb-4e9e-a27d-20f7e43085f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d168aeb-06a0-43bb-bcb0-3b0ca8112c65]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:54:32 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 (non-flash)
Nov 29 07:54:32 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b12521750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1cff8-14bc-40ec-87c3-5e1e0b35d6e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb08a59-be1a-4491-bb78-28f088cb5e3c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0af1b0-6ca9-42d6-90a3-b2c06791dee2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e9aa1-0b17-4230-a06f-45686d659923]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26134386337396361', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8210e5a0', '/dev/disk/by-id/scsi-1SCST_BIO8210e5a0-a48c79ca151e92fe') {{(pid=86370) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7667984c-38a0-4b08-beae-bfb9f02c8166]: (4, None) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.093s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2b3e6-cd9e-4234-8ab3-32773036a455]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3806f019-3705-442e-98ff-4ab9d457f85a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260]
Nov 29 07:54:32 user nova-compute[75373]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2, portal: 172.16.0.220,3260] successful.
Nov 29 07:54:32 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2536bef-3976-4356-80c7-dd8dad6f24d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dc71cd-541a-4125-8f49-432ab069eed5]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (392ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:54:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Deleting instance files /opt/stack/data/nova/instances/706e4af9-3d27-47c7-b5bc-42c75d9d3e90_del
Nov 29 07:54:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Deletion of /opt/stack/data/nova/instances/706e4af9-3d27-47c7-b5bc-42c75d9d3e90_del complete
Nov 29 07:54:32 user nova-compute[75373]: INFO nova.compute.manager [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 29 07:54:32 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:32 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:33 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:33 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:54:33 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Took 0.68 seconds to deallocate network for instance.
Nov 29 07:54:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-7cec9d2c-def2-4aca-8033-135f34b8eb79 req-4681eafd-c567-4567-8c4d-575fb1d8268a service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-deleted-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:33 user nova-compute[75373]: INFO nova.compute.manager [req-7cec9d2c-def2-4aca-8033-135f34b8eb79 req-4681eafd-c567-4567-8c4d-575fb1d8268a service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Neutron deleted interface 73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3; detaching it from the instance and deleting it from the info cache
Nov 29 07:54:33 user nova-compute[75373]: DEBUG nova.network.neutron [req-7cec9d2c-def2-4aca-8033-135f34b8eb79 req-4681eafd-c567-4567-8c4d-575fb1d8268a service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:54:33 user nova-compute[75373]: DEBUG nova.compute.manager [req-7cec9d2c-def2-4aca-8033-135f34b8eb79 req-4681eafd-c567-4567-8c4d-575fb1d8268a service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Detach interface failed, port_id=73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3, reason: Instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:34 user nova-compute[75373]: WARNING nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state active and task_state deleting.
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:34 user nova-compute[75373]: WARNING nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state active and task_state deleting.
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:34 user nova-compute[75373]: WARNING nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state active and task_state deleting.
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-unplugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Acquiring lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] No waiting events found dispatching network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:54:34 user nova-compute[75373]: WARNING nova.compute.manager [req-87735f29-d7d0-489a-8c90-561d250713aa req-ccb686ae-3207-4c7a-8575-16a1824d012b service nova] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Received unexpected event network-vif-plugged-73cb8520-b6db-45b9-9ffc-a4cfe85b6bf3 for instance with vm_state active and task_state deleting.
Nov 29 07:54:34 user nova-compute[75373]: INFO nova.compute.manager [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 706e4af9-3d27-47c7-b5bc-42c75d9d3e90] Deleting volume: e2536bef-3976-4356-80c7-dd8dad6f24d2 {{(pid=75373) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:34 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance 706e4af9-3d27-47c7-b5bc-42c75d9d3e90
Nov 29 07:54:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-57dac38a-ca1e-4625-ac21-0f28e9f47448 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "706e4af9-3d27-47c7-b5bc-42c75d9d3e90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.429s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:37 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:42 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:47 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:52 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:54:54 user nova-compute[75373]: INFO nova.compute.manager [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Attaching volume cc2b784d-a0fc-465a-b562-38ee8c0ee74d to /dev/vdb
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.utils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ad023-9f9e-4a3d-b3fc-7d8ed7f59b8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032d463-c1cc-4393-a324-08d648a7ab60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975bf4b-fca1-4673-8331-9428b29edceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914a232-b040-4eb0-8268-6e3a814952c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:54:54 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c40db7-8a0d-40c7-9f2f-6f01ec5a64d1]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG os_brick.utils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating existing volume attachment record: 392cdc53-0c27-4404-8133-c86cc20bfb0d {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:54:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:54:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:54:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:54:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:54:57 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:00 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:55:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:01 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197bfde-5d74-4d94-888f-7bb8a3bfccb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:55:01 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dc1f3-e870-4ae7-b6ec-3b2323070e0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d] added
Nov 29 07:55:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aac78b-b7f8-4210-a64a-0dee5e2a356f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2e3f5-adc1-4ccb-9c62-f29b63adeb20]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZCjmfvc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZCjmfvc" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[642af144-a31c-451c-9b0f-e5494c64b196]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PZCjmfvc'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e6a143-eda1-439c-b109-3625b6a99e23]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c6904-6dac-4011-aefc-67db6a2102c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:55:01 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:55:01 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:01 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:55:01 user nova-compute[75373]: 
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a423c44a-efa4-4bbd-96ea-b6c38f95a32a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]
Nov 29 07:55:01 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.
Nov 29 07:55:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0712a222-4622-45bd-af6d-ea8b94660f65]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[21842403-a129-406c-81d9-b7180132a018]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:01 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f469f-4af5-4d08-965f-a046470c5004]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:55:01 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23561626338346664', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561626338346664', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG nova.objects.instance [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 07:55:02 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:55:02 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:55:02 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:55:02 user nova-compute[75373]:   <serial>cc2b784d-a0fc-465a-b562-38ee8c0ee74d</serial>
Nov 29 07:55:02 user nova-compute[75373]: </disk>
Nov 29 07:55:02 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 07:55:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:55:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:55:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No VIF found with MAC fa:16:3e:d1:fc:01, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:55:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-1c8294fb-cf05-47e5-abbe-3b95573e23b4 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.246s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:55:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:55:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.997806549072266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:55:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:08 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing instance network info cache due to event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated VIF entry in instance network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-ff3a3fdf-29aa-46a0-9655-fb0ea9910aec req-7d630013-004f-40c7-ac04-2edda83e6311 service nova] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing instance network info cache due to event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG nova.network.neutron [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:55:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:12 user nova-compute[75373]: DEBUG nova.network.neutron [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated VIF entry in instance network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:55:12 user nova-compute[75373]: DEBUG nova.network.neutron [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-14a40208-499b-4f37-99cd-dac1ecd70b95 req-f7ddf138-5170-4348-b319-7bf3178bfc95 service nova] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:12 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:15 user nova-compute[75373]: INFO nova.compute.manager [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Rebooting instance
Nov 29 07:55:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG nova.network.neutron [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.compute.manager [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:16 user nova-compute[75373]: WARNING nova.compute.manager [req-adf89b18-4c00-4bc1-bd78-eb25cccd0d60 req-fb48c023-72eb-4ab9-99ea-8373fd105168 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance destroyed successfully.
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'resources' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:55:16Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0717663c-38, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03ab4ea3-6e2e-4c51-8642-5e007d1435e8) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:16 user nova-compute[75373]: INFO os_vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38')
Nov 29 07:55:16 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:55:16 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0638f-157b-4070-abb1-1df73717ee7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:55:16 user nova-compute[75373]: No targets found.
Nov 29 07:55:16 user nova-compute[75373]: iSNS:
Nov 29 07:55:16 user nova-compute[75373]: No targets found.
Nov 29 07:55:16 user nova-compute[75373]: STATIC:
Nov 29 07:55:16 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d
Nov 29 07:55:16 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:55:16 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:55:16 user nova-compute[75373]: FIRMWARE:
Nov 29 07:55:16 user nova-compute[75373]: No targets found.
Nov 29 07:55:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:55:16 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:55:16 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[778abb72-af6a-4743-a985-2394724da0c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[22992d7c-fa5c-4e87-a3e0-ab251321753e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:16 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0068eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b8ac0-9c73-4981-b931-adbcfda35701]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9109e15-0921-4928-b216-00519ade43f6]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb7152d-e5b9-49a1-a8a2-697e8d068e21]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:55:16 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8712d22-d88d-45aa-a4bb-a581220779c8]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f062b99-f33b-4ec0-9626-c93f261449c1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e75c6-de5f-40ac-abf5-dc750eabf6aa]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]
Nov 29 07:55:17 user nova-compute[75373]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.
Nov 29 07:55:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2968f-85c6-46d2-893c-cd0bb077a08f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== disconnect_volume: return (287ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start _get_guest_xml network_info=[{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4a6c33-0f01-41d7-9a67-e7f5c76c5419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'fa4a6c33-0f01-41d7-9a67-e7f5c76c5419'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e5588c49-75a4-44fb-b092-fe89bb9f3b27', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'serial': 'cc2b784d-a0fc-465a-b562-38ee8c0ee74d'}, 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '392cdc53-0c27-4404-8133-c86cc20bfb0d', 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:55:17 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:17 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4a6c33-0f01-41d7-9a67-e7f5c76c5419,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.objects.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Object Instance<e5588c49-75a4-44fb-b092-fe89bb9f3b27> lazy-loaded attributes: resources,vcpu_model {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:55:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:17 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0b132-9807-4416-ab15-92719c2e874f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:55:17 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5aa153-0461-4e5a-b6e2-c2545269318b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d] added
Nov 29 07:55:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fda096-98e2-4e7b-a5f8-4aa2f553e621]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bae86c-c8fa-45bd-8a1c-b35505556280]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZCjmfvc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PZCjmfvc" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee68a627-cd8a-43e1-8279-76908e4f6ae1]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PZCjmfvc'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a40a7-fe83-4097-8039-5687ff8b07ee]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b5ce4e-2b5a-4693-b3e4-4d8610c0bd30]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:55:17 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:55:17 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:55:17 user nova-compute[75373]: 
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[848f6eca-e9f0-42c3-965c-b57fc28ef8d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]
Nov 29 07:55:17 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.
Nov 29 07:55:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968dadd-7bbe-45e3-a535-7cf63d0cca2a]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a79c19e-5592-4ccc-b789-4155537376a8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8762f06e-9c83-4a93-983c-3582ca4b6901]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23561626338346664', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561626338346664', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:55:16Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'pci_devices' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.objects.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Object Instance<e5588c49-75a4-44fb-b092-fe89bb9f3b27> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:55:18 user nova-compute[75373]:   <uuid>e5588c49-75a4-44fb-b092-fe89bb9f3b27</uuid>
Nov 29 07:55:18 user nova-compute[75373]:   <name>instance-00000030</name>
Nov 29 07:55:18 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:55:18 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:55:18 user nova-compute[75373]:   <metadata>
Nov 29 07:55:18 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:55:18 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:name>tempest-TestMinimumBasicScenario-server-2087347124</nova:name>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:55:17</nova:creationTime>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:55:18 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:55:18 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:owner>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:user uuid="163bc599637749ff819b798c5efe7867">tempest-TestMinimumBasicScenario-1027187955-project-member</nova:user>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:project uuid="4ef78e97ba874f0cb154f8f941708330">tempest-TestMinimumBasicScenario-1027187955</nova:project>
Nov 29 07:55:18 user nova-compute[75373]:       </nova:owner>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:root type="image" uuid="fa4a6c33-0f01-41d7-9a67-e7f5c76c5419"/>
Nov 29 07:55:18 user nova-compute[75373]:       <nova:ports>
Nov 29 07:55:18 user nova-compute[75373]:         <nova:port uuid="0717663c-3893-442c-8284-c4d4ed7f8620">
Nov 29 07:55:18 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 07:55:18 user nova-compute[75373]:         </nova:port>
Nov 29 07:55:18 user nova-compute[75373]:       </nova:ports>
Nov 29 07:55:18 user nova-compute[75373]:     </nova:instance>
Nov 29 07:55:18 user nova-compute[75373]:   </metadata>
Nov 29 07:55:18 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:55:18 user nova-compute[75373]:     <system>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="serial">e5588c49-75a4-44fb-b092-fe89bb9f3b27</entry>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="uuid">e5588c49-75a4-44fb-b092-fe89bb9f3b27</entry>
Nov 29 07:55:18 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:55:18 user nova-compute[75373]:     </system>
Nov 29 07:55:18 user nova-compute[75373]:   </sysinfo>
Nov 29 07:55:18 user nova-compute[75373]:   <os>
Nov 29 07:55:18 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:55:18 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:55:18 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:55:18 user nova-compute[75373]:   </os>
Nov 29 07:55:18 user nova-compute[75373]:   <features>
Nov 29 07:55:18 user nova-compute[75373]:     <acpi/>
Nov 29 07:55:18 user nova-compute[75373]:     <apic/>
Nov 29 07:55:18 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:55:18 user nova-compute[75373]:   </features>
Nov 29 07:55:18 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:55:18 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:55:18 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:55:18 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:55:18 user nova-compute[75373]:   </clock>
Nov 29 07:55:18 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:55:18 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:55:18 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:55:18 user nova-compute[75373]:   </cpu>
Nov 29 07:55:18 user nova-compute[75373]:   <devices>
Nov 29 07:55:18 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:55:18 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:55:18 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk"/>
Nov 29 07:55:18 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:55:18 user nova-compute[75373]:     </disk>
Nov 29 07:55:18 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:55:18 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:55:18 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:55:18 user nova-compute[75373]:       <target dev="vdb" bus="virtio"/>
Nov 29 07:55:18 user nova-compute[75373]:       <serial>cc2b784d-a0fc-465a-b562-38ee8c0ee74d</serial>
Nov 29 07:55:18 user nova-compute[75373]:     </disk>
Nov 29 07:55:18 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:55:18 user nova-compute[75373]:       <mac address="fa:16:3e:d1:fc:01"/>
Nov 29 07:55:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:55:18 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:55:18 user nova-compute[75373]:       <target dev="tap0717663c-38"/>
Nov 29 07:55:18 user nova-compute[75373]:     </interface>
Nov 29 07:55:18 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:55:18 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/console.log" append="off"/>
Nov 29 07:55:18 user nova-compute[75373]:     </serial>
Nov 29 07:55:18 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:55:18 user nova-compute[75373]:     <video>
Nov 29 07:55:18 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:55:18 user nova-compute[75373]:     </video>
Nov 29 07:55:18 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:55:18 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:55:18 user nova-compute[75373]:     </rng>
Nov 29 07:55:18 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:55:18 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:55:18 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:55:18 user nova-compute[75373]:     </memballoon>
Nov 29 07:55:18 user nova-compute[75373]:   </devices>
Nov 29 07:55:18 user nova-compute[75373]: </domain>
Nov 29 07:55:18 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:18 user nova-compute[75373]: WARNING nova.compute.manager [req-35da924c-ee28-4c39-8cbd-aea09a2e5960 req-672f5a52-d8d6-43ce-a988-04af8f0a357c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG nova.objects.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Object Instance<e5588c49-75a4-44fb-b092-fe89bb9f3b27> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:55:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 --force-share --output=json" returned: 0 in 0.170s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Cannot resize image /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.objects.instance [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'migration_context' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.objects.base [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Object Instance<e5588c49-75a4-44fb-b092-fe89bb9f3b27> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75373) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:55:16Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG os_vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3860ce19-9e36-533a-9074-b8e4e373f58f', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0717663c-38, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0717663c-38, col_values=(('qos', UUID('e788cced-fc67-4062-ab35-3890fe09574f')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0717663c-38, col_values=(('external_ids', {'iface-id': '0717663c-3893-442c-8284-c4d4ed7f8620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:fc:01', 'vm-uuid': 'e5588c49-75a4-44fb-b092-fe89bb9f3b27'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:19 user nova-compute[75373]: INFO os_vif [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38')
Nov 29 07:55:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:20 user nova-compute[75373]: DEBUG nova.compute.manager [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:20 user nova-compute[75373]: WARNING nova.compute.manager [req-2c6f7a80-e0c5-4074-bfba-f3385c9287dc req-685e5cd9-1c35-46c0-ae4e-34a033b0ba64 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 07:55:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:55:22 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance rebooted successfully.
Nov 29 07:55:22 user nova-compute[75373]: DEBUG nova.compute.manager [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-7629fd24-5d0e-4608-a4d1-924b6161d0db tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.417s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:22 user nova-compute[75373]: DEBUG nova.compute.manager [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:22 user nova-compute[75373]: WARNING nova.compute.manager [req-5c0a96a2-9bb1-4455-8906-14aec9db49d0 req-aea894a6-560f-4e31-927f-1ff6f116649c service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state active and task_state None.
Nov 29 07:55:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:55:32 user nova-compute[75373]: INFO nova.compute.claims [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Claim successful on node user
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:55:32 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.policy [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:55:32 user nova-compute[75373]: INFO nova.virt.block_device [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Booting with volume f36a9c57-22bb-482e-9b1c-62b45f910cfd at /dev/vda
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b92b660-6dbe-460c-882f-69d54ac82359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9ba20-7934-4c43-a74d-0c8785bd8f87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a643e-74e7-49c7-9a16-a6ae7dc4aad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[47448f7d-f46c-4b16-80d0-cb927c0feb8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:55:32 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:55:32 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2dbd1f-ff45-4b54-8415-8aef039cb184]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG os_brick.utils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:55:32 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating existing volume attachment record: 238113fa-5d21-4673-a878-bbbe21f3bf85 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:55:33 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Successfully created port: e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Successfully updated port: e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-changed-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.compute.manager [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Refreshing instance network info cache due to event network-changed-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] Acquiring lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Instance network_info: |[{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] Acquired lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Refreshing network info cache for port e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updated VIF entry in instance network info cache for port e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG nova.network.neutron [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:34 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-1e604406-bddf-47e5-a620-406572b8425f req-f04dd677-c1f7-4786-b905-5d501a6e159c service nova] Releasing lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:55:40 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Creating image(s)
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Ensure instance console log exists: /opt/stack/data/nova/instances/a8218730-49db-4619-9fde-0acf8efb09b5/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Start _get_guest_xml network_info=[{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8218730-49db-4619-9fde-0acf8efb09b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'serial': 'f36a9c57-22bb-482e-9b1c-62b45f910cfd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '238113fa-5d21-4673-a878-bbbe21f3bf85', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:55:40 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:40 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:55:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:40 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:55:40 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1aa975-1ff7-44f0-af66-17381f88dadd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:55:40 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e6a08-8aac-47a4-87d8-ce431f8ea7c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd] added
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[97008ff8-d1cf-421f-a994-24e487e8c10c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630720d-6a5a-42bb-b7d9-90e7395e031c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIJYQCvq {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIJYQCvq" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44abe08-9c44-4bf5-a427-e620d6a7e8ed]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIJYQCvq'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043570d-28f7-46bb-9098-f50009b61d09]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6666e84b-39b0-4f5c-af80-306557b61bdc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492e1fd-daa0-426c-b1a4-ee88c8aa4f27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]
Nov 29 07:55:40 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c958258e-895e-4496-bd27-e5c70437c099]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6071f86-50c5-4b1e-b2aa-530f30f5ffbf]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:40 user nova-compute[75373]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:55:40 user nova-compute[75373]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:55:40 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26dadc-d4cb-468b-9494-a920339011e9]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:55:40 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23139626535343261', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139626535343261', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60354345',display_name='tempest-TestVolumeBootPattern-server-60354345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60354345',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-q5yiwnhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:55:33Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=a8218730-49db-4619-9fde-0acf8efb09b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.objects.instance [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid a8218730-49db-4619-9fde-0acf8efb09b5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:55:41 user nova-compute[75373]:   <uuid>a8218730-49db-4619-9fde-0acf8efb09b5</uuid>
Nov 29 07:55:41 user nova-compute[75373]:   <name>instance-00000031</name>
Nov 29 07:55:41 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:55:41 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:55:41 user nova-compute[75373]:   <metadata>
Nov 29 07:55:41 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:55:41 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:55:41 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-server-60354345</nova:name>
Nov 29 07:55:41 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:55:40</nova:creationTime>
Nov 29 07:55:41 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:55:41 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:55:41 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:55:41 user nova-compute[75373]:       <nova:owner>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 07:55:41 user nova-compute[75373]:       </nova:owner>
Nov 29 07:55:41 user nova-compute[75373]:       <nova:ports>
Nov 29 07:55:41 user nova-compute[75373]:         <nova:port uuid="e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4">
Nov 29 07:55:41 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 07:55:41 user nova-compute[75373]:         </nova:port>
Nov 29 07:55:41 user nova-compute[75373]:       </nova:ports>
Nov 29 07:55:41 user nova-compute[75373]:     </nova:instance>
Nov 29 07:55:41 user nova-compute[75373]:   </metadata>
Nov 29 07:55:41 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:55:41 user nova-compute[75373]:     <system>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="serial">a8218730-49db-4619-9fde-0acf8efb09b5</entry>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="uuid">a8218730-49db-4619-9fde-0acf8efb09b5</entry>
Nov 29 07:55:41 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:55:41 user nova-compute[75373]:     </system>
Nov 29 07:55:41 user nova-compute[75373]:   </sysinfo>
Nov 29 07:55:41 user nova-compute[75373]:   <os>
Nov 29 07:55:41 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:55:41 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:55:41 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:55:41 user nova-compute[75373]:   </os>
Nov 29 07:55:41 user nova-compute[75373]:   <features>
Nov 29 07:55:41 user nova-compute[75373]:     <acpi/>
Nov 29 07:55:41 user nova-compute[75373]:     <apic/>
Nov 29 07:55:41 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:55:41 user nova-compute[75373]:   </features>
Nov 29 07:55:41 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:55:41 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:55:41 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:55:41 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:55:41 user nova-compute[75373]:   </clock>
Nov 29 07:55:41 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:55:41 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:55:41 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:55:41 user nova-compute[75373]:   </cpu>
Nov 29 07:55:41 user nova-compute[75373]:   <devices>
Nov 29 07:55:41 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:55:41 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:55:41 user nova-compute[75373]:       <source dev="/dev/sdc"/>
Nov 29 07:55:41 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:55:41 user nova-compute[75373]:       <serial>f36a9c57-22bb-482e-9b1c-62b45f910cfd</serial>
Nov 29 07:55:41 user nova-compute[75373]:     </disk>
Nov 29 07:55:41 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:55:41 user nova-compute[75373]:       <mac address="fa:16:3e:42:99:77"/>
Nov 29 07:55:41 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:55:41 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:55:41 user nova-compute[75373]:       <target dev="tape34a96ea-3e"/>
Nov 29 07:55:41 user nova-compute[75373]:     </interface>
Nov 29 07:55:41 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:55:41 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/a8218730-49db-4619-9fde-0acf8efb09b5/console.log" append="off"/>
Nov 29 07:55:41 user nova-compute[75373]:     </serial>
Nov 29 07:55:41 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:55:41 user nova-compute[75373]:     <video>
Nov 29 07:55:41 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:55:41 user nova-compute[75373]:     </video>
Nov 29 07:55:41 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:55:41 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:55:41 user nova-compute[75373]:     </rng>
Nov 29 07:55:41 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:55:41 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:55:41 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:55:41 user nova-compute[75373]:     </memballoon>
Nov 29 07:55:41 user nova-compute[75373]:   </devices>
Nov 29 07:55:41 user nova-compute[75373]: </domain>
Nov 29 07:55:41 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60354345',display_name='tempest-TestVolumeBootPattern-server-60354345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60354345',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-q5yiwnhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:55:33Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=a8218730-49db-4619-9fde-0acf8efb09b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG os_vif [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed5a7179-0345-57db-9d39-dbfb1e2497d8', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape34a96ea-3e, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape34a96ea-3e, col_values=(('qos', UUID('786d4592-7767-402a-9adf-2bb140f68eb6')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape34a96ea-3e, col_values=(('external_ids', {'iface-id': 'e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:99:77', 'vm-uuid': 'a8218730-49db-4619-9fde-0acf8efb09b5'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:41 user nova-compute[75373]: INFO os_vif [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e')
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:55:41 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:42:99:77, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG nova.compute.manager [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] No waiting events found dispatching network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:43 user nova-compute[75373]: WARNING nova.compute.manager [req-f10cebd6-440e-4e15-b62d-c4733f229837 req-ba5b9fc4-49e0-443d-892c-380e7b0e4394 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received unexpected event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 for instance with vm_state building and task_state spawning.
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:55:45 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Instance spawned successfully.
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:55:45 user nova-compute[75373]: INFO nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:45 user nova-compute[75373]: DEBUG nova.compute.manager [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] No waiting events found dispatching network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:55:45 user nova-compute[75373]: WARNING nova.compute.manager [req-6a04d45b-f654-456d-a9fb-a43348cab8f6 req-b153be0a-4698-4327-93fa-e8c4fc70733b service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received unexpected event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 for instance with vm_state building and task_state spawning.
Nov 29 07:55:45 user nova-compute[75373]: INFO nova.compute.manager [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Took 13.06 seconds to build instance.
Nov 29 07:55:45 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-b41f4686-cc67-40c0-8a20-4b84d162855d tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.165s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:55:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:55:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:55:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:55:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:55:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:55:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:56:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:56:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:56:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.9942626953125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a8218730-49db-4619-9fde-0acf8efb09b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:56:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:56:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:56:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.003s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Verify base images {{(pid=75373) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75373) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Image id fa4a6c33-0f01-41d7-9a67-e7f5c76c5419 yields fingerprint 3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 {{(pid=75373) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] image fa4a6c33-0f01-41d7-9a67-e7f5c76c5419 at (/opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1): checking
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] image fa4a6c33-0f01-41d7-9a67-e7f5c76c5419 at (/opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1): image is in use {{(pid=75373) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] a8218730-49db-4619-9fde-0acf8efb09b5 is a valid instance name {{(pid=75373) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] e5588c49-75a4-44fb-b092-fe89bb9f3b27 is a valid instance name {{(pid=75373) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] e5588c49-75a4-44fb-b092-fe89bb9f3b27 has a disk file {{(pid=75373) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 is backed by 3851fa0eb600fdbde7e06b35b7aad7666dc5ace1 {{(pid=75373) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66
Nov 29 07:56:28 user nova-compute[75373]: WARNING nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Unknown base file: /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Active base files: /opt/stack/data/nova/instances/_base/3851fa0eb600fdbde7e06b35b7aad7666dc5ace1
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Removable base files: /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121 /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1 /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193 /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1 /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84 /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66 /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c2ef5fe7c8470043de97829fdf1a3a0a26e00121
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c3b94b709f38dbfbe7e0758dc6b8445fcc7895f1
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3bfc5b8d0c01ce84b61c152d6d9e1d1f1c045193
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba587c688997f94a30a181a290260229a917a2f1
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/74c1725423b9ada79d72b4a7fb399dfa4cf9a92b
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/29b8cfdaba0a0c985bf64d9954e466e64ee3fb84
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4174b4e77be6b7384d849ae23da9062962e9cb66
Nov 29 07:56:28 user nova-compute[75373]: INFO nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/23eca19a4145123bc68c894151a80c1f5aa474d0
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Verification complete {{(pid=75373) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Verify swap images {{(pid=75373) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 07:56:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.imagecache [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Verify ephemeral images {{(pid=75373) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 07:56:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:56:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:56:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:56:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:56:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:56:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:57:04 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:57:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:57:05 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.99361801147461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a8218730-49db-4619-9fde-0acf8efb09b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 07:57:05 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing instance network info cache due to event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated VIF entry in instance network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG nova.network.neutron [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55599c9b-a362-4072-b771-66cf6aa9b816 req-71d3b328-cb30-454d-91dc-b5af5d1225c7 service nova] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing instance network info cache due to event network-changed-0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Refreshing network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:08 user nova-compute[75373]: INFO nova.compute.manager [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Detaching volume cc2b784d-a0fc-465a-b562-38ee8c0ee74d
Nov 29 07:57:08 user nova-compute[75373]: INFO nova.virt.block_device [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Attempting to driver detach volume cc2b784d-a0fc-465a-b562-38ee8c0ee74d from mountpoint /dev/vdb
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Attempting to detach device vdb from instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:57:08 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:57:08 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:57:08 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:57:08 user nova-compute[75373]:   <serial>cc2b784d-a0fc-465a-b562-38ee8c0ee74d</serial>
Nov 29 07:57:08 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:57:08 user nova-compute[75373]: </disk>
Nov 29 07:57:08 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:57:08 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully detached device vdb from instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 from the persistent domain config.
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 07:57:08 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:57:08 user nova-compute[75373]:   <source dev="/dev/sdb"/>
Nov 29 07:57:08 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 07:57:08 user nova-compute[75373]:   <serial>cc2b784d-a0fc-465a-b562-38ee8c0ee74d</serial>
Nov 29 07:57:08 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 07:57:08 user nova-compute[75373]: </disk>
Nov 29 07:57:08 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated VIF entry in instance network info cache for port 0717663c-3893-442c-8284-c4d4ed7f8620. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6992c73d-cb49-4042-b85b-6419c3f44d29 req-3bd17857-5744-4829-8e09-fc84ae2c9e58 service nova] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:57:08 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 07:57:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 07:57:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:23 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-changed-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:24 user nova-compute[75373]: DEBUG nova.compute.manager [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Refreshing instance network info cache due to event network-changed-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:57:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] Acquiring lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:57:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] Acquired lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:57:24 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Refreshing network info cache for port e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updated VIF entry in instance network info cache for port e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.network.neutron [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [{"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fe063247-a5ce-42dc-aabe-b9e0241d71e5 req-edec9434-e139-4ae0-915b-103f78777cb2 service nova] Releasing lock "refresh_cache-a8218730-49db-4619-9fde-0acf8efb09b5" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:25 user nova-compute[75373]: INFO nova.compute.manager [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Terminating instance
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-unplugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] No waiting events found dispatching network-vif-unplugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.compute.manager [req-d66cac97-902c-4d19-acd6-49d89c45e6fa req-8f44cdf6-6c23-4de5-ad70-7366beb4e35c service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-unplugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:57:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Instance destroyed successfully.
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid a8218730-49db-4619-9fde-0acf8efb09b5 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:55:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60354345',display_name='tempest-TestVolumeBootPattern-server-60354345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60354345',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:55:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-q5yiwnhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:55:45Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=a8218730-49db-4619-9fde-0acf8efb09b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "address": "fa:16:3e:42:99:77", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34a96ea-3e", "ovs_interfaceid": "e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_vif [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape34a96ea-3e, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=786d4592-7767-402a-9adf-2bb140f68eb6) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:25 user nova-compute[75373]: INFO os_vif [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:99:77,bridge_name='br-int',has_traffic_filtering=True,id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34a96ea-3e')
Nov 29 07:57:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:57:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f98084-f8b0-48f9-84f1-6906e03bae6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:57:25 user nova-compute[75373]: No targets found.
Nov 29 07:57:25 user nova-compute[75373]: iSNS:
Nov 29 07:57:25 user nova-compute[75373]: No targets found.
Nov 29 07:57:25 user nova-compute[75373]: STATIC:
Nov 29 07:57:25 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd
Nov 29 07:57:25 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:57:25 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:57:25 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d
Nov 29 07:57:25 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:57:25 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:57:25 user nova-compute[75373]: FIRMWARE:
Nov 29 07:57:25 user nova-compute[75373]: No targets found.
Nov 29 07:57:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:57:25 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:57:25 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32a84d-9b59-4316-86c5-b34e7fb9ca65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249aac1-0f1a-4cec-bc70-8eaefffd1e1c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:57:25 user nova-compute[75373]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:57:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:57:25 user nova-compute[75373]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:57:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b00419f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f6b86-c9ad-49ab-a4a1-f410f88c2468]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d699269b-b35a-410b-9d85-509764e4bd9b]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b17fd-334a-4ea3-a535-9ecd922e10f0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6ad279-bf79-435a-abf0-3c07a52d4beb]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23139626535343261', '/dev/disk/by-id/scsi-1SCST_BIO3b4edb4-19be542ac00dc044', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3b4edb4') {{(pid=86370) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec41cee-d6a8-4249-86ce-0fcd7f93bff9]: (4, None) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7e414-5a51-400e-8cf5-96ef97854f82]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be477b3-8c8d-4ae9-a204-af621b21d042]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]
Nov 29 07:57:26 user nova-compute[75373]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.
Nov 29 07:57:26 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b183af7b-b29a-4428-b89c-65ac431d2199]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (292ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:57:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Deleting instance files /opt/stack/data/nova/instances/a8218730-49db-4619-9fde-0acf8efb09b5_del
Nov 29 07:57:26 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Deletion of /opt/stack/data/nova/instances/a8218730-49db-4619-9fde-0acf8efb09b5_del complete
Nov 29 07:57:26 user nova-compute[75373]: INFO nova.compute.manager [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 29 07:57:26 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:26 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-21fb69a1-10a8-4819-83a8-6b586231ed87 req-08fd7033-d104-48ed-a1e8-c13c17dfbff8 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-deleted-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:27 user nova-compute[75373]: INFO nova.compute.manager [req-21fb69a1-10a8-4819-83a8-6b586231ed87 req-08fd7033-d104-48ed-a1e8-c13c17dfbff8 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Neutron deleted interface e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4; detaching it from the instance and deleting it from the info cache
Nov 29 07:57:27 user nova-compute[75373]: DEBUG nova.network.neutron [req-21fb69a1-10a8-4819-83a8-6b586231ed87 req-08fd7033-d104-48ed-a1e8-c13c17dfbff8 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:27 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Took 0.79 seconds to deallocate network for instance.
Nov 29 07:57:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-21fb69a1-10a8-4819-83a8-6b586231ed87 req-08fd7033-d104-48ed-a1e8-c13c17dfbff8 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Detach interface failed, port_id=e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4, reason: Instance a8218730-49db-4619-9fde-0acf8efb09b5 could not be found. {{(pid=75373) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] Acquiring lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] Lock "a8218730-49db-4619-9fde-0acf8efb09b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] No waiting events found dispatching network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:57:27 user nova-compute[75373]: WARNING nova.compute.manager [req-a59ae367-2e2e-4259-ba0f-593dc1093db6 req-e473a5da-338d-4346-9d5b-dfe0a2ba3d90 service nova] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Received unexpected event network-vif-plugged-e34a96ea-3ea4-4e7a-bb9d-0fedfb04cbf4 for instance with vm_state active and task_state deleting.
Nov 29 07:57:27 user nova-compute[75373]: INFO nova.compute.manager [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: a8218730-49db-4619-9fde-0acf8efb09b5] Took 0.83 seconds to detach 1 volumes for instance.
Nov 29 07:57:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:57:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:28 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance a8218730-49db-4619-9fde-0acf8efb09b5
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-29f2da5e-5678-437a-9bab-ee5fcdf7d19b tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "a8218730-49db-4619-9fde-0acf8efb09b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:28 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 is timed out.
Nov 29 07:57:28 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully detached device vdb from instance e5588c49-75a4-44fb-b092-fe89bb9f3b27 from the live domain config.
Nov 29 07:57:28 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PZCjmfvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:57:28 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a500083-edef-4e44-92e1-bf434e8e67d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 07:57:28 user nova-compute[75373]: No targets found.
Nov 29 07:57:28 user nova-compute[75373]: iSNS:
Nov 29 07:57:28 user nova-compute[75373]: No targets found.
Nov 29 07:57:28 user nova-compute[75373]: STATIC:
Nov 29 07:57:28 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d
Nov 29 07:57:28 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 07:57:28 user nova-compute[75373]:                 Iface Name: default
Nov 29 07:57:28 user nova-compute[75373]: FIRMWARE:
Nov 29 07:57:28 user nova-compute[75373]: No targets found.
Nov 29 07:57:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 07:57:28 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 07:57:28 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899a774-ebaf-41b5-9a8b-2c917eba2379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbae138-b8cd-4561-ab31-766a94548409]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:57:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d (non-flash)
Nov 29 07:57:28 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3b0041b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 07:57:28 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d670c-55ec-4c1a-b216-84c99a68ba95]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7e562-328d-40fd-ab23-3eed2360990c]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea1f2bd-302f-49db-8432-e23453ad0fb2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c86d6-229f-4779-9701-0957720ed160]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b82262-d950-44c9-a726-3233cc40f82c]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc4393-aeb8-4a3e-9727-795f438fae13]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260]
Nov 29 07:57:29 user nova-compute[75373]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d, portal: 172.16.0.220,3260] successful.
Nov 29 07:57:29 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc2b784d-a0fc-465a-b562-38ee8c0ee74d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf2455-59dc-4ee6-8ad6-b27986f9f7c2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== disconnect_volume: return (281ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 07:57:29 user nova-compute[75373]: DEBUG nova.objects.instance [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:57:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-ccba52af-d82e-45e6-b3ff-b98f821c42bc tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:57:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:57:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:57:54 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:57:55 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [{"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:57:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-e5588c49-75a4-44fb-b092-fe89bb9f3b27" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:57:55 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:57:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:02 user nova-compute[75373]: INFO nova.compute.manager [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Terminating instance
Nov 29 07:58:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG nova.compute.manager [req-49b19b32-3308-43a1-a32d-e2d38cdc82c8 req-21ca9a27-bf2d-4b1c-892f-f16a000e8827 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-unplugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 07:58:02 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Instance destroyed successfully.
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.objects.instance [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'resources' on Instance uuid e5588c49-75a4-44fb-b092-fe89bb9f3b27 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:53:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2087347124',display_name='tempest-TestMinimumBasicScenario-server-2087347124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2087347124',id=48,image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdhg3p4EMi1IokfTv3FYshunrCjHTJ7tC6i8/rgYp/MDTboan1J/TpYrqnFpe1+ufVx5bTqCO6l0zSWTiHPLYQsNsvxP7YfPdy4hh2LFtQXhbcH7LL6CU/sFSAuktk+fw==',key_name='tempest-TestMinimumBasicScenario-523089218',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-xirn612e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa4a6c33-0f01-41d7-9a67-e7f5c76c5419',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:55:23Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=e5588c49-75a4-44fb-b092-fe89bb9f3b27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "0717663c-3893-442c-8284-c4d4ed7f8620", "address": "fa:16:3e:d1:fc:01", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0717663c-38", "ovs_interfaceid": "0717663c-3893-442c-8284-c4d4ed7f8620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG os_vif [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0717663c-38, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e788cced-fc67-4062-ab35-3890fe09574f) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: INFO os_vif [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:fc:01,bridge_name='br-int',has_traffic_filtering=True,id=0717663c-3893-442c-8284-c4d4ed7f8620,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0717663c-38')
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Deleting instance files /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27_del
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Deletion of /opt/stack/data/nova/instances/e5588c49-75a4-44fb-b092-fe89bb9f3b27_del complete
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.compute.manager [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Took 0.47 seconds to deallocate network for instance.
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-576a35fd-7722-4304-961b-ed8dc9bbbced req-fb300eae-8c8a-40ec-8964-5025310b2743 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-deleted-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:03 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Deleted allocations for instance e5588c49-75a4-44fb-b092-fe89bb9f3b27
Nov 29 07:58:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-38943c69-709d-45d8-81c2-a03c570f89b3 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:04 user nova-compute[75373]: WARNING nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state deleted and task_state None.
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:04 user nova-compute[75373]: WARNING nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state deleted and task_state None.
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Acquiring lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] Lock "e5588c49-75a4-44fb-b092-fe89bb9f3b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:04 user nova-compute[75373]: DEBUG nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] No waiting events found dispatching network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:04 user nova-compute[75373]: WARNING nova.compute.manager [req-4457778c-b61f-449b-9041-7646dd5ec657 req-85a99f24-d12b-484c-9acf-9d0e3a546393 service nova] [instance: e5588c49-75a4-44fb-b092-fe89bb9f3b27] Received unexpected event network-vif-plugged-0717663c-3893-442c-8284-c4d4ed7f8620 for instance with vm_state deleted and task_state None.
Nov 29 07:58:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:05 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:05 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:58:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:06 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9126MB free_disk=25.012481689453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:58:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:58:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:13 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:58:16 user nova-compute[75373]: INFO nova.compute.claims [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Claim successful on node user
Nov 29 07:58:16 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:58:16 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:58:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.policy [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:58:17 user nova-compute[75373]: INFO nova.virt.block_device [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Booting with volume f36a9c57-22bb-482e-9b1c-62b45f910cfd at /dev/vda
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.utils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ae5a42-d157-4162-b9e6-6c49b24ccca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d341974-794f-4ef5-80b7-5cb57811cccd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c445e8-5289-49d9-8554-9cd481a7909b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3c640-0862-43f5-bcf6-e38d988457b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 07:58:17 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 07:58:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77dc64a-2a1c-444f-a6d0-ced2d53261a7]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG os_brick.utils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating existing volume attachment record: 8cc39a70-535e-4dee-9695-e663ae92239d {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Successfully created port: 8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Successfully updated port: 8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-changed-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.compute.manager [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing instance network info cache due to event network-changed-8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Instance network_info: |[{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:58:18 user nova-compute[75373]: DEBUG nova.network.neutron [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing network info cache for port 8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:58:19 user nova-compute[75373]: DEBUG nova.network.neutron [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated VIF entry in instance network info cache for port 8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:58:19 user nova-compute[75373]: DEBUG nova.network.neutron [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e1d74acd-5f1e-45d6-a674-3e87568cd6fb req-2ade1f8d-0c6b-41b8-b65d-be1571dcec62 service nova] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:23 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:58:24 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Creating image(s)
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Ensure instance console log exists: /opt/stack/data/nova/instances/cfc0dd8e-69d3-462f-811c-07e20dc5af4a/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Start _get_guest_xml network_info=[{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfc0dd8e-69d3-462f-811c-07e20dc5af4a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'serial': 'f36a9c57-22bb-482e-9b1c-62b45f910cfd'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '8cc39a70-535e-4dee-9695-e663ae92239d', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:58:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:24 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 07:58:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:58:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 07:58:24 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c231d-e671-4d9a-b211-5b7d3ee26c45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 07:58:24 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[143956c8-2cd6-4bbb-9b7e-22f3b695ed32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd] added
Nov 29 07:58:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04d604-496b-46fb-94da-3c44fcb070f0]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ced0a6-216d-4cf3-a2cf-4add4dcb9051]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIJYQCvq {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIJYQCvq" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[147665b7-fda1-41a8-b879-55bf6fb3bc99]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIJYQCvq'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ba888-e686-4df1-8ee1-4ac79dd3696f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf91b22-20b7-41b6-b826-e1f623d4d399]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:58:24 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 07:58:24 user nova-compute[75373]:  {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:58:24 user nova-compute[75373]: WARNING os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 07:58:24 user nova-compute[75373]: 
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ca844b-7544-4475-af18-bbba56f9fd39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]
Nov 29 07:58:24 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.
Nov 29 07:58:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b328d94-7fce-4d5a-bee0-e01cce669d16]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf64ea6-f248-49dc-a41b-7aa1bd4cc87f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:58:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 07:58:24 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777fa94-b824-4604-afdd-aa498c80239a]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 07:58:24 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23139626535343261', 'path': '/dev/sdb'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139626535343261', 'path': '/dev/sdb'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1019254850',display_name='tempest-TestVolumeBootPattern-server-1019254850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1019254850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-4ve0k9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:58:17Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=cfc0dd8e-69d3-462f-811c-07e20dc5af4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.objects.instance [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid cfc0dd8e-69d3-462f-811c-07e20dc5af4a {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:58:25 user nova-compute[75373]:   <uuid>cfc0dd8e-69d3-462f-811c-07e20dc5af4a</uuid>
Nov 29 07:58:25 user nova-compute[75373]:   <name>instance-00000032</name>
Nov 29 07:58:25 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:58:25 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:58:25 user nova-compute[75373]:   <metadata>
Nov 29 07:58:25 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:58:25 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:58:25 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-server-1019254850</nova:name>
Nov 29 07:58:25 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:58:24</nova:creationTime>
Nov 29 07:58:25 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:58:25 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:58:25 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:58:25 user nova-compute[75373]:       <nova:owner>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 07:58:25 user nova-compute[75373]:       </nova:owner>
Nov 29 07:58:25 user nova-compute[75373]:       <nova:ports>
Nov 29 07:58:25 user nova-compute[75373]:         <nova:port uuid="8a791927-534f-4791-966d-fae7262edc36">
Nov 29 07:58:25 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 07:58:25 user nova-compute[75373]:         </nova:port>
Nov 29 07:58:25 user nova-compute[75373]:       </nova:ports>
Nov 29 07:58:25 user nova-compute[75373]:     </nova:instance>
Nov 29 07:58:25 user nova-compute[75373]:   </metadata>
Nov 29 07:58:25 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:58:25 user nova-compute[75373]:     <system>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="serial">cfc0dd8e-69d3-462f-811c-07e20dc5af4a</entry>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="uuid">cfc0dd8e-69d3-462f-811c-07e20dc5af4a</entry>
Nov 29 07:58:25 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:58:25 user nova-compute[75373]:     </system>
Nov 29 07:58:25 user nova-compute[75373]:   </sysinfo>
Nov 29 07:58:25 user nova-compute[75373]:   <os>
Nov 29 07:58:25 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:58:25 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:58:25 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:58:25 user nova-compute[75373]:   </os>
Nov 29 07:58:25 user nova-compute[75373]:   <features>
Nov 29 07:58:25 user nova-compute[75373]:     <acpi/>
Nov 29 07:58:25 user nova-compute[75373]:     <apic/>
Nov 29 07:58:25 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:58:25 user nova-compute[75373]:   </features>
Nov 29 07:58:25 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:58:25 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:58:25 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:58:25 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:58:25 user nova-compute[75373]:   </clock>
Nov 29 07:58:25 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:58:25 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:58:25 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:58:25 user nova-compute[75373]:   </cpu>
Nov 29 07:58:25 user nova-compute[75373]:   <devices>
Nov 29 07:58:25 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 07:58:25 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 07:58:25 user nova-compute[75373]:       <source dev="/dev/sdb"/>
Nov 29 07:58:25 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:58:25 user nova-compute[75373]:       <serial>f36a9c57-22bb-482e-9b1c-62b45f910cfd</serial>
Nov 29 07:58:25 user nova-compute[75373]:     </disk>
Nov 29 07:58:25 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:58:25 user nova-compute[75373]:       <mac address="fa:16:3e:f9:a7:1a"/>
Nov 29 07:58:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:58:25 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:58:25 user nova-compute[75373]:       <target dev="tap8a791927-53"/>
Nov 29 07:58:25 user nova-compute[75373]:     </interface>
Nov 29 07:58:25 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:58:25 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/cfc0dd8e-69d3-462f-811c-07e20dc5af4a/console.log" append="off"/>
Nov 29 07:58:25 user nova-compute[75373]:     </serial>
Nov 29 07:58:25 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:58:25 user nova-compute[75373]:     <video>
Nov 29 07:58:25 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:58:25 user nova-compute[75373]:     </video>
Nov 29 07:58:25 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:58:25 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:58:25 user nova-compute[75373]:     </rng>
Nov 29 07:58:25 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:58:25 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:58:25 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:58:25 user nova-compute[75373]:     </memballoon>
Nov 29 07:58:25 user nova-compute[75373]:   </devices>
Nov 29 07:58:25 user nova-compute[75373]: </domain>
Nov 29 07:58:25 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1019254850',display_name='tempest-TestVolumeBootPattern-server-1019254850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1019254850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-4ve0k9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:58:17Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=cfc0dd8e-69d3-462f-811c-07e20dc5af4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG os_vif [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55c751ae-b820-5f90-ace7-263c6c276414', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a791927-53, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a791927-53, col_values=(('qos', UUID('b9cea652-6d4c-48e5-bafd-ee1fb542048e')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a791927-53, col_values=(('external_ids', {'iface-id': '8a791927-534f-4791-966d-fae7262edc36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:a7:1a', 'vm-uuid': 'cfc0dd8e-69d3-462f-811c-07e20dc5af4a'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:25 user nova-compute[75373]: INFO os_vif [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53')
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:58:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:f9:a7:1a, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG nova.compute.manager [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] No waiting events found dispatching network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:27 user nova-compute[75373]: WARNING nova.compute.manager [req-f3b8b661-a1f3-4d66-8544-04c2945b3ca1 req-878c0f66-5af2-438b-9062-8f5f18050f19 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received unexpected event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 for instance with vm_state building and task_state spawning.
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:27 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:58:29 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Instance spawned successfully.
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:58:29 user nova-compute[75373]: INFO nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:58:29 user nova-compute[75373]: INFO nova.compute.manager [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Took 12.55 seconds to build instance.
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:29 user nova-compute[75373]: DEBUG nova.compute.manager [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] No waiting events found dispatching network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:58:29 user nova-compute[75373]: WARNING nova.compute.manager [req-06e394c7-f2ee-42a3-8bf1-fe2aecb136ed req-66ef693f-7b4f-4206-b55b-a53120da29d5 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received unexpected event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 for instance with vm_state active and task_state None.
Nov 29 07:58:29 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-35f12532-1afa-45cf-ad26-fb2f6356da90 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.646s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:30 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:35 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:58:40 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:45 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:55 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 07:58:56 user nova-compute[75373]: INFO nova.compute.claims [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Claim successful on node user
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 07:58:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Skipping network cache update for instance because it is Building. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.policy [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '163bc599637749ff819b798c5efe7867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef78e97ba874f0cb154f8f941708330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 07:58:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Creating image(s)
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "/opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "/opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "/opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "6481f0e3d27784e2c06bb271c71eb730c200052b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "6481f0e3d27784e2c06bb271c71eb730c200052b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:58:56 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid cfc0dd8e-69d3-462f-811c-07e20dc5af4a {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.part --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG nova.virt.images [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] 052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed was qcow2, converting to raw {{(pid=75373) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG nova.privsep.utils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75373) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.part /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.converted {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Successfully created port: 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.part /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.converted" returned: 0 in 0.368s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.converted --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "6481f0e3d27784e2c06bb271c71eb730c200052b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.267s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json" returned: 0 in 0.196s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "6481f0e3d27784e2c06bb271c71eb730c200052b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "6481f0e3d27784e2c06bb271c71eb730c200052b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json" returned: 0 in 0.171s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b,backing_fmt=raw /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk 1073741824 {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b,backing_fmt=raw /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk 1073741824" returned: 0 in 0.051s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "6481f0e3d27784e2c06bb271c71eb730c200052b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Successfully updated port: 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.compute.manager [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing instance network info cache due to event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6481f0e3d27784e2c06bb271c71eb730c200052b --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk. size=1073741824 {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.virt.disk.api [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Cannot resize image /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk to a smaller size. {{(pid=75373) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Created local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Ensure instance console log exists: /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:58:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.neutron [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance network_info: |[{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Start _get_guest_xml network_info=[{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:58:54Z,direct_url=<?>,disk_format='qcow2',id=052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed,min_disk=0,min_ram=0,name='tempest-scenario-img--476208532',owner='4ef78e97ba874f0cb154f8f941708330',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:58:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 07:58:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:59 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T07:58:54Z,direct_url=<?>,disk_format='qcow2',id=052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed,min_disk=0,min_ram=0,name='tempest-scenario-img--476208532',owner='4ef78e97ba874f0cb154f8f941708330',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T07:58:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-615096918',display_name='tempest-TestMinimumBasicScenario-server-615096918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-615096918',id=51,image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqHcA7E550dY8s8pIpGZ+WRXRRYBIS9yvTTXX6bQ3MfTWmuFIG+KaVH57IqCEbpzuPHEEx+xVKT6damjJwjcGwo9eCICXswEn9tMRuUaDUt6jkN+fC8sAjsWRABHY6zKg==',key_name='tempest-TestMinimumBasicScenario-1679106016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-9rbpuo2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:58:57Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=a62799fd-e91c-4606-acf7-af43787188c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.objects.instance [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'pci_devices' on Instance uuid a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 07:58:59 user nova-compute[75373]:   <uuid>a62799fd-e91c-4606-acf7-af43787188c4</uuid>
Nov 29 07:58:59 user nova-compute[75373]:   <name>instance-00000033</name>
Nov 29 07:58:59 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 07:58:59 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 07:58:59 user nova-compute[75373]:   <metadata>
Nov 29 07:58:59 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 07:58:59 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:name>tempest-TestMinimumBasicScenario-server-615096918</nova:name>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:creationTime>2023-11-29 07:58:59</nova:creationTime>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 07:58:59 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 07:58:59 user nova-compute[75373]:       </nova:flavor>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:owner>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:user uuid="163bc599637749ff819b798c5efe7867">tempest-TestMinimumBasicScenario-1027187955-project-member</nova:user>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:project uuid="4ef78e97ba874f0cb154f8f941708330">tempest-TestMinimumBasicScenario-1027187955</nova:project>
Nov 29 07:58:59 user nova-compute[75373]:       </nova:owner>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:root type="image" uuid="052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed"/>
Nov 29 07:58:59 user nova-compute[75373]:       <nova:ports>
Nov 29 07:58:59 user nova-compute[75373]:         <nova:port uuid="2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e">
Nov 29 07:58:59 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 07:58:59 user nova-compute[75373]:         </nova:port>
Nov 29 07:58:59 user nova-compute[75373]:       </nova:ports>
Nov 29 07:58:59 user nova-compute[75373]:     </nova:instance>
Nov 29 07:58:59 user nova-compute[75373]:   </metadata>
Nov 29 07:58:59 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 07:58:59 user nova-compute[75373]:     <system>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="serial">a62799fd-e91c-4606-acf7-af43787188c4</entry>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="uuid">a62799fd-e91c-4606-acf7-af43787188c4</entry>
Nov 29 07:58:59 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 07:58:59 user nova-compute[75373]:     </system>
Nov 29 07:58:59 user nova-compute[75373]:   </sysinfo>
Nov 29 07:58:59 user nova-compute[75373]:   <os>
Nov 29 07:58:59 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 07:58:59 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 07:58:59 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 07:58:59 user nova-compute[75373]:   </os>
Nov 29 07:58:59 user nova-compute[75373]:   <features>
Nov 29 07:58:59 user nova-compute[75373]:     <acpi/>
Nov 29 07:58:59 user nova-compute[75373]:     <apic/>
Nov 29 07:58:59 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 07:58:59 user nova-compute[75373]:   </features>
Nov 29 07:58:59 user nova-compute[75373]:   <clock offset="utc">
Nov 29 07:58:59 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 07:58:59 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 07:58:59 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 07:58:59 user nova-compute[75373]:   </clock>
Nov 29 07:58:59 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 07:58:59 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 07:58:59 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 07:58:59 user nova-compute[75373]:   </cpu>
Nov 29 07:58:59 user nova-compute[75373]:   <devices>
Nov 29 07:58:59 user nova-compute[75373]:     <disk type="file" device="disk">
Nov 29 07:58:59 user nova-compute[75373]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 07:58:59 user nova-compute[75373]:       <source file="/opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk"/>
Nov 29 07:58:59 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 07:58:59 user nova-compute[75373]:     </disk>
Nov 29 07:58:59 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 07:58:59 user nova-compute[75373]:       <mac address="fa:16:3e:d6:b0:52"/>
Nov 29 07:58:59 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:58:59 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 07:58:59 user nova-compute[75373]:       <target dev="tap2cc4374f-71"/>
Nov 29 07:58:59 user nova-compute[75373]:     </interface>
Nov 29 07:58:59 user nova-compute[75373]:     <serial type="pty">
Nov 29 07:58:59 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/console.log" append="off"/>
Nov 29 07:58:59 user nova-compute[75373]:     </serial>
Nov 29 07:58:59 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 07:58:59 user nova-compute[75373]:     <video>
Nov 29 07:58:59 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 07:58:59 user nova-compute[75373]:     </video>
Nov 29 07:58:59 user nova-compute[75373]:     <rng model="virtio">
Nov 29 07:58:59 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 07:58:59 user nova-compute[75373]:     </rng>
Nov 29 07:58:59 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 07:58:59 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 07:58:59 user nova-compute[75373]:       <stats period="10"/>
Nov 29 07:58:59 user nova-compute[75373]:     </memballoon>
Nov 29 07:58:59 user nova-compute[75373]:   </devices>
Nov 29 07:58:59 user nova-compute[75373]: </domain>
Nov 29 07:58:59 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-615096918',display_name='tempest-TestMinimumBasicScenario-server-615096918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-615096918',id=51,image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqHcA7E550dY8s8pIpGZ+WRXRRYBIS9yvTTXX6bQ3MfTWmuFIG+KaVH57IqCEbpzuPHEEx+xVKT6damjJwjcGwo9eCICXswEn9tMRuUaDUt6jkN+fC8sAjsWRABHY6zKg==',key_name='tempest-TestMinimumBasicScenario-1679106016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-9rbpuo2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T07:58:57Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=a62799fd-e91c-4606-acf7-af43787188c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG os_vif [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b888927f-7240-5b9a-9513-bb3f607f1c12', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cc4374f-71, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cc4374f-71, col_values=(('qos', UUID('c98eb9ef-e592-4c45-8c08-7ec6197ec88a')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cc4374f-71, col_values=(('external_ids', {'iface-id': '2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:b0:52', 'vm-uuid': 'a62799fd-e91c-4606-acf7-af43787188c4'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:58:59 user nova-compute[75373]: INFO os_vif [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71')
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No VIF found with MAC fa:16:3e:d6:b0:52, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated VIF entry in instance network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG nova.network.neutron [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:58:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e6dd747b-4133-4e23-b1eb-57b562afe328 req-df9817d6-fa98-43c1-a10a-6c69e412971b service nova] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG nova.compute.manager [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:59:00 user nova-compute[75373]: DEBUG nova.compute.manager [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:59:00 user nova-compute[75373]: WARNING nova.compute.manager [req-0fd4cf06-da90-4e5e-b45d-98e439b6713f req-5547abb8-5c63-4cac-add2-0c88e228be40 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state building and task_state spawning.
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 07:59:02 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance spawned successfully.
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 07:59:02 user nova-compute[75373]: INFO nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 29 07:59:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 07:59:03 user nova-compute[75373]: WARNING nova.compute.manager [req-2a0139bc-15d9-4b28-b2f7-3f9fff6d8b16 req-3405d85f-995c-4a8c-b4ba-0fa8f54b29b8 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state building and task_state spawning.
Nov 29 07:59:03 user nova-compute[75373]: INFO nova.compute.manager [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Took 6.71 seconds to build instance.
Nov 29 07:59:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-9a5c6833-4a6c-4eff-8497-80d9a68d8d73 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.802s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:59:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 07:59:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 07:59:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:59:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.988677978515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a62799fd-e91c-4606-acf7-af43787188c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 07:59:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 07:59:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:19 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:28 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:54 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 07:59:56 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid cfc0dd8e-69d3-462f-811c-07e20dc5af4a {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 07:59:57 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 07:59:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 07:59:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 07:59:59 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:04 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:00:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:00:06 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:00:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:00:07 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.960311889648438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a62799fd-e91c-4606-acf7-af43787188c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:00:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-changed-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing instance network info cache due to event network-changed-8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing network info cache for port 8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated VIF entry in instance network info cache for port 8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-21722a82-c3b9-455e-ad34-d0ce9a7754cc req-e5314ee7-d945-4b90-a107-cddb311e872f service nova] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:00:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:00:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Starting instance... {{(pid=75373) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75373) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 08:00:17 user nova-compute[75373]: INFO nova.compute.claims [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Claim successful on node user
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Start building networks asynchronously for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Allocating IP information in the background. {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] allocate_for_instance() {{(pid=75373) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 08:00:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Start building block device mappings for instance. {{(pid=75373) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 08:00:17 user nova-compute[75373]: DEBUG nova.policy [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00a5f98116e64893bd35e1a4e34e7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f92519c816456f9f7acab9ceed7842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75373) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 08:00:17 user nova-compute[75373]: INFO nova.virt.block_device [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Booting with volume 2d52cf1e-931c-4a25-833a-a382710a2904 at /dev/vda
Nov 29 08:00:17 user nova-compute[75373]: DEBUG os_brick.utils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3843b3-95bd-4af4-8408-91ef26ac63e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfccf0-c806-44a4-a05e-1742c3ec001f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c491fff-202c-485a-aa86-6a521620ebf0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd12a2a-ebdb-469c-bd88-e9e08cfddf42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 08:00:18 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6b870-2597-4768-aea0-cd28bab46f8a]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG os_brick.utils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating existing volume attachment record: 262037eb-dced-4f8b-b3d7-c47451698a70 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:18 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Successfully created port: 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Successfully updated port: 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquired lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.compute.manager [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing instance network info cache due to event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] Acquiring lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Instance cache missing network info. {{(pid=75373) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.network.neutron [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating instance_info_cache with network_info: [{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Releasing lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Instance network_info: |[{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75373) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] Acquired lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:00:19 user nova-compute[75373]: DEBUG nova.network.neutron [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:00:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updated VIF entry in instance network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:00:20 user nova-compute[75373]: DEBUG nova.network.neutron [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating instance_info_cache with network_info: [{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:00:20 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-aaf95d7d-060d-4591-a667-b8e4161725d2 req-792e2b86-a78c-4c02-9848-31a725dc3552 service nova] Releasing lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:00:20 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:00:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Start spawning the instance on the hypervisor. {{(pid=75373) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Creating instance directory {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 08:00:25 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Creating image(s)
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Did not create local disks {{(pid=75373) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Ensure instance console log exists: /opt/stack/data/nova/instances/57f47626-7865-4b0b-a6b8-1aa3e18d7c39/console.log {{(pid=75373) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Start _get_guest_xml network_info=[{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPvTHOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57f47626-7865-4b0b-a6b8-1aa3e18d7c39', 'attached_at': '', 'detached_at': '', 'volume_id': '2d52cf1e-931c-4a25-833a-a382710a2904', 'serial': '2d52cf1e-931c-4a25-833a-a382710a2904'}, 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '262037eb-dced-4f8b-b3d7-c47451698a70', 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 08:00:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:00:25 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller missing on host. {{(pid=75373) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.host [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU controller found on host. {{(pid=75373) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75373) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T07:16:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image limits 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flavor pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Image pref 0:0:0 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75373) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Got 1 possible topologies {{(pid=75373) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.hardware [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75373) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPvTHOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:00:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:00:25 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:00:25 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67a63e-e5d4-4c38-b60f-b51189ec3bb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 08:00:25 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20754b0-ce01-499b-bfac-012cae4153d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904] added
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[40597c07-de32-413b-9c76-599106f77af2]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc6d3d-f056-4dac-8add-07c83f5864ac]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPvTHOo {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abPvTHOo" returned: 0 in 0.029s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c938bff2-42fa-48a3-962b-9fdca0c8355d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abPvTHOo'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecb305-8bb0-4e9b-b226-5cdff3b74bf4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797c9db-aed3-4963-8b45-530f45440df2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf9f08e-cada-40ee-b736-dec26202b557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260]
Nov 29 08:00:25 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260] successful.
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf5358-ff52-461f-89b7-d9faf1611847]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d339e1-47b1-4829-8069-28aede752598]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:25 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:25 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:25 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e6b89-206d-46a3-987a-4f0a330c72eb]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 08:00:25 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPvTHOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26235366535616433', 'path': '/dev/sdc'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235366535616433', 'path': '/dev/sdc'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T08:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34640362',display_name='tempest-TestVolumeBootPattern-server-34640362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34640362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-ij7efmk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T08:00:18Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=57f47626-7865-4b0b-a6b8-1aa3e18d7c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75373) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.objects.instance [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'pci_devices' on Instance uuid 57f47626-7865-4b0b-a6b8-1aa3e18d7c39 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] End _get_guest_xml xml=<domain type="kvm">
Nov 29 08:00:26 user nova-compute[75373]:   <uuid>57f47626-7865-4b0b-a6b8-1aa3e18d7c39</uuid>
Nov 29 08:00:26 user nova-compute[75373]:   <name>instance-00000034</name>
Nov 29 08:00:26 user nova-compute[75373]:   <memory>524288</memory>
Nov 29 08:00:26 user nova-compute[75373]:   <vcpu>1</vcpu>
Nov 29 08:00:26 user nova-compute[75373]:   <metadata>
Nov 29 08:00:26 user nova-compute[75373]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 08:00:26 user nova-compute[75373]:       <nova:package version="0.0.0"/>
Nov 29 08:00:26 user nova-compute[75373]:       <nova:name>tempest-TestVolumeBootPattern-server-34640362</nova:name>
Nov 29 08:00:26 user nova-compute[75373]:       <nova:creationTime>2023-11-29 08:00:25</nova:creationTime>
Nov 29 08:00:26 user nova-compute[75373]:       <nova:flavor name="m1.tiny">
Nov 29 08:00:26 user nova-compute[75373]:         <nova:memory>512</nova:memory>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:disk>1</nova:disk>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:swap>0</nova:swap>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:vcpus>1</nova:vcpus>
Nov 29 08:00:26 user nova-compute[75373]:       </nova:flavor>
Nov 29 08:00:26 user nova-compute[75373]:       <nova:owner>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:user uuid="00a5f98116e64893bd35e1a4e34e7e45">tempest-TestVolumeBootPattern-305019745-project-member</nova:user>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:project uuid="b9f92519c816456f9f7acab9ceed7842">tempest-TestVolumeBootPattern-305019745</nova:project>
Nov 29 08:00:26 user nova-compute[75373]:       </nova:owner>
Nov 29 08:00:26 user nova-compute[75373]:       <nova:ports>
Nov 29 08:00:26 user nova-compute[75373]:         <nova:port uuid="37d4c0b4-7f6a-4f55-8679-0def3e4f4cda">
Nov 29 08:00:26 user nova-compute[75373]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 08:00:26 user nova-compute[75373]:         </nova:port>
Nov 29 08:00:26 user nova-compute[75373]:       </nova:ports>
Nov 29 08:00:26 user nova-compute[75373]:     </nova:instance>
Nov 29 08:00:26 user nova-compute[75373]:   </metadata>
Nov 29 08:00:26 user nova-compute[75373]:   <sysinfo type="smbios">
Nov 29 08:00:26 user nova-compute[75373]:     <system>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="product">OpenStack Nova</entry>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="version">0.0.0</entry>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="serial">57f47626-7865-4b0b-a6b8-1aa3e18d7c39</entry>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="uuid">57f47626-7865-4b0b-a6b8-1aa3e18d7c39</entry>
Nov 29 08:00:26 user nova-compute[75373]:       <entry name="family">Virtual Machine</entry>
Nov 29 08:00:26 user nova-compute[75373]:     </system>
Nov 29 08:00:26 user nova-compute[75373]:   </sysinfo>
Nov 29 08:00:26 user nova-compute[75373]:   <os>
Nov 29 08:00:26 user nova-compute[75373]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 08:00:26 user nova-compute[75373]:     <boot dev="hd"/>
Nov 29 08:00:26 user nova-compute[75373]:     <smbios mode="sysinfo"/>
Nov 29 08:00:26 user nova-compute[75373]:   </os>
Nov 29 08:00:26 user nova-compute[75373]:   <features>
Nov 29 08:00:26 user nova-compute[75373]:     <acpi/>
Nov 29 08:00:26 user nova-compute[75373]:     <apic/>
Nov 29 08:00:26 user nova-compute[75373]:     <vmcoreinfo/>
Nov 29 08:00:26 user nova-compute[75373]:   </features>
Nov 29 08:00:26 user nova-compute[75373]:   <clock offset="utc">
Nov 29 08:00:26 user nova-compute[75373]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 08:00:26 user nova-compute[75373]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 08:00:26 user nova-compute[75373]:     <timer name="hpet" present="no"/>
Nov 29 08:00:26 user nova-compute[75373]:   </clock>
Nov 29 08:00:26 user nova-compute[75373]:   <cpu mode="custom" match="exact">
Nov 29 08:00:26 user nova-compute[75373]:     <model>Nehalem</model>
Nov 29 08:00:26 user nova-compute[75373]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 08:00:26 user nova-compute[75373]:   </cpu>
Nov 29 08:00:26 user nova-compute[75373]:   <devices>
Nov 29 08:00:26 user nova-compute[75373]:     <disk type="block" device="disk">
Nov 29 08:00:26 user nova-compute[75373]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 08:00:26 user nova-compute[75373]:       <source dev="/dev/sdc"/>
Nov 29 08:00:26 user nova-compute[75373]:       <target dev="vda" bus="virtio"/>
Nov 29 08:00:26 user nova-compute[75373]:       <serial>2d52cf1e-931c-4a25-833a-a382710a2904</serial>
Nov 29 08:00:26 user nova-compute[75373]:     </disk>
Nov 29 08:00:26 user nova-compute[75373]:     <interface type="ethernet">
Nov 29 08:00:26 user nova-compute[75373]:       <mac address="fa:16:3e:e3:92:d0"/>
Nov 29 08:00:26 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 08:00:26 user nova-compute[75373]:       <mtu size="1442"/>
Nov 29 08:00:26 user nova-compute[75373]:       <target dev="tap37d4c0b4-7f"/>
Nov 29 08:00:26 user nova-compute[75373]:     </interface>
Nov 29 08:00:26 user nova-compute[75373]:     <serial type="pty">
Nov 29 08:00:26 user nova-compute[75373]:       <log file="/opt/stack/data/nova/instances/57f47626-7865-4b0b-a6b8-1aa3e18d7c39/console.log" append="off"/>
Nov 29 08:00:26 user nova-compute[75373]:     </serial>
Nov 29 08:00:26 user nova-compute[75373]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 08:00:26 user nova-compute[75373]:     <video>
Nov 29 08:00:26 user nova-compute[75373]:       <model type="virtio"/>
Nov 29 08:00:26 user nova-compute[75373]:     </video>
Nov 29 08:00:26 user nova-compute[75373]:     <rng model="virtio">
Nov 29 08:00:26 user nova-compute[75373]:       <backend model="random">/dev/urandom</backend>
Nov 29 08:00:26 user nova-compute[75373]:     </rng>
Nov 29 08:00:26 user nova-compute[75373]:     <controller type="usb" index="0" model="none"/>
Nov 29 08:00:26 user nova-compute[75373]:     <memballoon model="virtio">
Nov 29 08:00:26 user nova-compute[75373]:       <stats period="10"/>
Nov 29 08:00:26 user nova-compute[75373]:     </memballoon>
Nov 29 08:00:26 user nova-compute[75373]:   </devices>
Nov 29 08:00:26 user nova-compute[75373]: </domain>
Nov 29 08:00:26 user nova-compute[75373]:  {{(pid=75373) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T08:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34640362',display_name='tempest-TestVolumeBootPattern-server-34640362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34640362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-ij7efmk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T08:00:18Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=57f47626-7865-4b0b-a6b8-1aa3e18d7c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG os_vif [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f') {{(pid=75373) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '875fe813-5d7b-5681-94be-5afa59cfc538', '_type': 'linux-noop'}}, row=False) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d4c0b4-7f, may_exist=True, interface_attrs={}) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37d4c0b4-7f, col_values=(('qos', UUID('9ca190d5-cc6d-4179-b6b4-402300f3e3cb')),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37d4c0b4-7f, col_values=(('external_ids', {'iface-id': '37d4c0b4-7f6a-4f55-8679-0def3e4f4cda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:92:d0', 'vm-uuid': '57f47626-7865-4b0b-a6b8-1aa3e18d7c39'}),), if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:26 user nova-compute[75373]: INFO os_vif [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f')
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 08:00:26 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] No VIF found with MAC fa:16:3e:e3:92:d0, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:28 user nova-compute[75373]: DEBUG nova.compute.manager [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:00:28 user nova-compute[75373]: WARNING nova.compute.manager [req-0c9a2e7b-6ac7-40e8-8658-de76faae6407 req-6e0acab7-c065-4cbb-8a67-7a592c048ca4 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state building and task_state spawning.
Nov 29 08:00:28 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Instance event wait completed in 0 seconds for  {{(pid=75373) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Guest created on hypervisor {{(pid=75373) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 08:00:30 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Instance spawned successfully.
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_cdrom_bus of ide {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_disk_bus of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_input_bus of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_pointer_model of None {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_video_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Found default for hw_vif_model of virtio {{(pid=75373) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.compute.manager [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:00:30 user nova-compute[75373]: WARNING nova.compute.manager [req-c861b5ae-aa37-4c61-9271-fc186ecf14bb req-56fddcd3-198e-4bbd-abb9-c437bb66cb8d service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state building and task_state spawning.
Nov 29 08:00:30 user nova-compute[75373]: INFO nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 29 08:00:30 user nova-compute[75373]: DEBUG nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 08:00:30 user nova-compute[75373]: INFO nova.compute.manager [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Took 12.98 seconds to build instance.
Nov 29 08:00:30 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-c63d15c8-da15-4cde-964f-a22b09331902 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.068s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG nova.objects.instance [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:00:49 user nova-compute[75373]: INFO nova.compute.manager [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Attaching volume 9cb9d5d6-e586-4d76-8580-8846b9734bc5 to /dev/vdb
Nov 29 08:00:49 user nova-compute[75373]: DEBUG os_brick.utils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395df5b-cd8d-40c1-9f85-9b037c6744ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:778398a8ce46\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c6253-ef9a-46d4-a778-65d77069aed3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed522e8d-9b84-4d93-8d1e-3042fcdfa970]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d4c0db-7f7f-4fef-817f-82f4f246cdfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:49 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Running cmd (subprocess): nvme version {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] 'nvme version' failed. Not Retrying. {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] nvme not present on system {{(pid=75373) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 08:00:50 user nova-compute[75373]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 08:00:50 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5359cd7f-9f4a-40b8-8ee2-96679d98388c]: (4, '') {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75373) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.lightos [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] LIGHTOS: no hostnqn found. {{(pid=75373) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG os_brick.utils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:778398a8ce46', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:00:50 user nova-compute[75373]: DEBUG nova.virt.block_device [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating existing volume attachment record: e4b4407a-9ec9-49e1-96eb-eac59ef76364 {{(pid=75373) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 08:00:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Calling os-brick to attach iSCSI Volume {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmJzeqIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:00:56 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:00:56 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:00:56 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:00:56 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:00:56 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:00:56 user nova-compute[75373]: INFO os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 08:00:56 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1c493-906d-4821-9404-3007d4f85310]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 08:00:57 user nova-compute[75373]:  {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0207abd5-77a3-484a-a564-a60c42e46053]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5] added\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5] added
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4227d-9411-48a6-9fb1-04072f349df4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4c979-d8da-4a03-b635-fe259d71264f]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmJzeqIP {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZmJzeqIP" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee7e7f-9237-4d94-83ac-37c26f0c2133]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZmJzeqIP'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578ae4c-b427-41ab-8880-93db9744dfab]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e6a919-af6b-4805-9b97-dcdbbb6c1355]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --login {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c8f27f-a053-437d-801a-acfced1bbdb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260]
Nov 29 08:00:57 user nova-compute[75373]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260] successful.
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd0beb8-8389-473b-95c2-10aecf15352e]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8820e8b-6c28-41ff-bc09-af6a86097f38]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:00:57 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to 172.16.0.220:3260 {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75373) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75373) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c290c7-17e0-4ed0-bf19-d35b86a04f1e]: (4, ('- - 0', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75373) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 08:00:57 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmJzeqIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75373) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26431626234316438', 'path': '/dev/sdd'} {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431626234316438', 'path': '/dev/sdd'} {{(pid=75373) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 08:00:58 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 08:00:58 user nova-compute[75373]:   <source dev="/dev/sdd"/>
Nov 29 08:00:58 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 08:00:58 user nova-compute[75373]:   <serial>9cb9d5d6-e586-4d76-8580-8846b9734bc5</serial>
Nov 29 08:00:58 user nova-compute[75373]: </disk>
Nov 29 08:00:58 user nova-compute[75373]:  {{(pid=75373) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vda, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75373) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] No VIF found with MAC fa:16:3e:d6:b0:52, not building metadata {{(pid=75373) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 08:00:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-52f84c3f-2493-447a-859c-004701b319ad tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.076s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG nova.compute.manager [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing instance network info cache due to event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated VIF entry in instance network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG nova.network.neutron [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f10c3b17-1a1b-4853-81f6-dcd1891e0b3d req-93f0548f-3c7d-4dee-b66e-767625d1a7e6 service nova] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:01:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG nova.compute.manager [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing instance network info cache due to event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG nova.network.neutron [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:03 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:03 user nova-compute[75373]: INFO nova.compute.manager [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Rebooting instance
Nov 29 08:01:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated VIF entry in instance network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG nova.network.neutron [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e8c3102d-72e6-4ff4-b325-c26e3c763caf req-22bbee62-f665-45c0-93d3-6b58d3431f08 service nova] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Building network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG nova.network.neutron [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:01:04 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 08:01:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG nova.compute.manager [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:01:07 user nova-compute[75373]: WARNING nova.compute.manager [req-d05d223f-140c-4630-b375-f4230fe6958a req-2d7510b0-66f8-4a4e-9287-528a0472fcc2 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state active and task_state reboot_started.
Nov 29 08:01:07 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance shutdown successfully.
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:07 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:01:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:01:09 user nova-compute[75373]: WARNING nova.compute.manager [req-0dfe1451-c25b-42a9-bec6-6cc32edb381e req-5be26ed1-10cd-4591-a27e-a280fe15c4e1 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state active and task_state reboot_started.
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:01:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:01:11 user nova-compute[75373]: WARNING nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state active and task_state reboot_started.
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:01:11 user nova-compute[75373]: WARNING nova.compute.manager [req-dd625436-2fcf-44aa-a0c3-505b953ef162 req-fdb891be-8331-487a-bc20-c2573e149108 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state active and task_state reboot_started.
Nov 29 08:01:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:01:11 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.957637786865234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:01:11 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance running successfully.
Nov 29 08:01:11 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance soft rebooted successfully.
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.manager [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Checking state {{(pid=75373) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-f2d38fb8-5b6f-4ff2-a71b-3fac849e54b8 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.531s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a62799fd-e91c-4606-acf7-af43787188c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 57f47626-7865-4b0b-a6b8-1aa3e18d7c39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:01:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:01:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:18 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:20 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:30 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:01:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 08:01:58 user nova-compute[75373]: DEBUG nova.objects.instance [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lazy-loading 'info_cache' on Instance uuid cfc0dd8e-69d3-462f-811c-07e20dc5af4a {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:01:59 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:01:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:01:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 08:02:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:05 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:02:08 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing instance network info cache due to event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] Acquiring lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] Acquired lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:02:09 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:02:09 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=8844MB free_disk=24.95630645751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a62799fd-e91c-4606-acf7-af43787188c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance 57f47626-7865-4b0b-a6b8-1aa3e18d7c39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing inventories for resource provider 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating ProviderTree inventory for provider 7470e514-a168-44fb-900f-165629289ced from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Updating inventory in ProviderTree for provider 7470e514-a168-44fb-900f-165629289ced with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 08:02:09 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing aggregate associations for resource provider 7470e514-a168-44fb-900f-165629289ced, aggregates: None {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Refreshing trait associations for resource provider 7470e514-a168-44fb-900f-165629289ced, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75373) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updated VIF entry in instance network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating instance_info_cache with network_info: [{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-0bdd1a28-f698-4c24-ae8c-9892aa366bd1 req-809713a2-0f97-4ee3-8251-fce6f6e9187c service nova] Releasing lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing instance network info cache due to event network-changed-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] Acquiring lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] Acquired lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Refreshing network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:10 user nova-compute[75373]: INFO nova.compute.manager [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Terminating instance
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.compute.manager [req-3122db6b-2475-4596-9eb5-6976069ffd1f req-98c144b9-9df2-480c-bad3-42cc9d197fb0 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updated VIF entry in instance network info cache for port 37d4c0b4-7f6a-4f55-8679-0def3e4f4cda. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG nova.network.neutron [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating instance_info_cache with network_info: [{"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-8c86f3c5-eb6d-4871-95cc-6ff2016f0a4d req-fcfb891b-6ab1-4252-a2cc-34df0741c505 service nova] Releasing lock "refresh_cache-57f47626-7865-4b0b-a6b8-1aa3e18d7c39" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Instance destroyed successfully.
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.objects.instance [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid 57f47626-7865-4b0b-a6b8-1aa3e18d7c39 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T08:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-34640362',display_name='tempest-TestVolumeBootPattern-server-34640362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-34640362',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=<?>,launch_index=0,launched_at=2023-11-29T08:00:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-ij7efmk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T08:00:30Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=57f47626-7865-4b0b-a6b8-1aa3e18d7c39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "address": "fa:16:3e:e3:92:d0", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d4c0b4-7f", "ovs_interfaceid": "37d4c0b4-7f6a-4f55-8679-0def3e4f4cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_vif [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d4c0b4-7f, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ca190d5-cc6d-4179-b6b4-402300f3e3cb) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:11 user nova-compute[75373]: INFO os_vif [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:92:d0,bridge_name='br-int',has_traffic_filtering=True,id=37d4c0b4-7f6a-4f55-8679-0def3e4f4cda,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d4c0b4-7f')
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abPvTHOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:02:11 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17187d-84ce-4561-86d8-ff414a0582c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 08:02:11 user nova-compute[75373]: No targets found.
Nov 29 08:02:11 user nova-compute[75373]: iSNS:
Nov 29 08:02:11 user nova-compute[75373]: No targets found.
Nov 29 08:02:11 user nova-compute[75373]: STATIC:
Nov 29 08:02:11 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904
Nov 29 08:02:11 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:02:11 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:02:11 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd
Nov 29 08:02:11 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:02:11 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:02:11 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5
Nov 29 08:02:11 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:02:11 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:02:11 user nova-compute[75373]: FIRMWARE:
Nov 29 08:02:11 user nova-compute[75373]: No targets found.
Nov 29 08:02:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 08:02:11 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 08:02:11 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cd969-8687-4320-8099-c72755cb942e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1162da-61ef-42ce-89d3-da72154d643b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:02:11 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:02:11 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:02:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:02:11 user nova-compute[75373]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 (non-flash)
Nov 29 08:02:11 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:02:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae013ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904'): ({'sdc'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdc {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d2079-482c-4f71-b30e-cba3f964a54e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0cd42-d068-46bf-a1c0-75f24268916b]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdc {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[910a36d1-a9dc-407e-ad88-6c7744308aff]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1eae4f-cd84-48c0-9b5c-0bbd8ac89852]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdc have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb3b17bfc-b56e5ad315c34da0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b3b17bfc', '/dev/disk/by-id/scsi-26235366535616433') {{(pid=86370) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[289f1374-1d69-4576-875b-3a6874e71268]: (4, None) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4693c55-f163-4f8f-b4f4-bfee71cdbdc7]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16e5e3-1e27-4f98-94f1-3c87c0db6fec]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260]
Nov 29 08:02:11 user nova-compute[75373]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904, portal: 172.16.0.220,3260] successful.
Nov 29 08:02:11 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d52cf1e-931c-4a25-833a-a382710a2904 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e3707-948c-43d1-b619-f6e2794d62c4]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (325ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 08:02:11 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Deleting instance files /opt/stack/data/nova/instances/57f47626-7865-4b0b-a6b8-1aa3e18d7c39_del
Nov 29 08:02:11 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Deletion of /opt/stack/data/nova/instances/57f47626-7865-4b0b-a6b8-1aa3e18d7c39_del complete
Nov 29 08:02:11 user nova-compute[75373]: INFO nova.compute.manager [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 29 08:02:11 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 08:02:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:02:12 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Took 0.60 seconds to deallocate network for instance.
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-e06e32d7-0afe-47c3-99bb-e20f1fefabb1 req-6c96648b-92e6-4cae-b1ef-bedf94859ab9 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-deleted-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:12 user nova-compute[75373]: WARNING nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state active and task_state deleting.
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:12 user nova-compute[75373]: WARNING nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state active and task_state deleting.
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:12 user nova-compute[75373]: WARNING nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state active and task_state deleting.
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-unplugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Acquiring lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] No waiting events found dispatching network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:02:12 user nova-compute[75373]: WARNING nova.compute.manager [req-42973ed2-dec4-425e-a487-a60f9c10d0db req-35c62a94-1716-443b-ab7f-17183fbfabd6 service nova] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Received unexpected event network-vif-plugged-37d4c0b4-7f6a-4f55-8679-0def3e4f4cda for instance with vm_state active and task_state deleting.
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:12 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:02:13 user nova-compute[75373]: INFO nova.compute.manager [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: 57f47626-7865-4b0b-a6b8-1aa3e18d7c39] Took 0.85 seconds to detach 1 volumes for instance.
Nov 29 08:02:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:13 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:02:13 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:02:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:13 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance 57f47626-7865-4b0b-a6b8-1aa3e18d7c39
Nov 29 08:02:13 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-3752e1fc-e619-4d07-94c5-156729492008 tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "57f47626-7865-4b0b-a6b8-1aa3e18d7c39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.012s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:02:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:16 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75373) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 08:02:20 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:21 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:23 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Cleaning up deleted instances {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 08:02:23 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] There are 0 instances to clean {{(pid=75373) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:55 user nova-compute[75373]: DEBUG nova.compute.manager [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing instance network info cache due to event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:02:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:02:55 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:02:55 user nova-compute[75373]: DEBUG nova.network.neutron [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated VIF entry in instance network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-6b3635d9-486d-48b5-949e-72684a21afea req-2ae2a63a-0509-4867-84bf-e6335ed3950b service nova] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.compute.manager [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing instance network info cache due to event network-changed-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Refreshing network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:02:56 user nova-compute[75373]: INFO nova.compute.manager [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Detaching volume 9cb9d5d6-e586-4d76-8580-8846b9734bc5
Nov 29 08:02:56 user nova-compute[75373]: INFO nova.virt.block_device [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Attempting to driver detach volume 9cb9d5d6-e586-4d76-8580-8846b9734bc5 from mountpoint /dev/vdb
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Attempting to detach device vdb from instance a62799fd-e91c-4606-acf7-af43787188c4 from the persistent domain config. {{(pid=75373) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 08:02:56 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 08:02:56 user nova-compute[75373]:   <source dev="/dev/sdd"/>
Nov 29 08:02:56 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 08:02:56 user nova-compute[75373]:   <serial>9cb9d5d6-e586-4d76-8580-8846b9734bc5</serial>
Nov 29 08:02:56 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 08:02:56 user nova-compute[75373]: </disk>
Nov 29 08:02:56 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 08:02:56 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully detached device vdb from instance a62799fd-e91c-4606-acf7-af43787188c4 from the persistent domain config.
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a62799fd-e91c-4606-acf7-af43787188c4 from the live domain config. {{(pid=75373) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.virt.libvirt.guest [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 08:02:56 user nova-compute[75373]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 08:02:56 user nova-compute[75373]:   <source dev="/dev/sdd"/>
Nov 29 08:02:56 user nova-compute[75373]:   <target dev="vdb" bus="virtio"/>
Nov 29 08:02:56 user nova-compute[75373]:   <serial>9cb9d5d6-e586-4d76-8580-8846b9734bc5</serial>
Nov 29 08:02:56 user nova-compute[75373]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 08:02:56 user nova-compute[75373]: </disk>
Nov 29 08:02:56 user nova-compute[75373]:  {{(pid=75373) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated VIF entry in instance network info cache for port 2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG nova.network.neutron [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:02:56 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-55fa8411-c499-4f92-b117-c98aef961003 req-59658412-9128-4a74-b25e-46258c0685e0 service nova] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:02:57 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 08:02:59 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:02:59 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:02:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:02:59 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquired lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:02:59 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Forcefully refreshing network info cache for instance {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 08:03:00 user nova-compute[75373]: DEBUG nova.network.neutron [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [{"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:03:00 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Releasing lock "refresh_cache-a62799fd-e91c-4606-acf7-af43787188c4" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:03:00 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updated the network info_cache for instance {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 08:03:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:06 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-changed-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG nova.compute.manager [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing instance network info cache due to event network-changed-8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] Acquiring lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] Acquired lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 08:03:08 user nova-compute[75373]: DEBUG nova.network.neutron [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Refreshing network info cache for port 8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:09 user nova-compute[75373]: INFO nova.compute.manager [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Terminating instance
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.compute.manager [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-unplugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] No waiting events found dispatching network-vif-unplugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.compute.manager [req-a052c654-122e-4fc2-ab5a-7061ae7af04f req-53d22977-b8d7-41ce-9af4-194c4220cf78 service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-unplugged-8a791927-534f-4791-966d-fae7262edc36 for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updated VIF entry in instance network info cache for port 8a791927-534f-4791-966d-fae7262edc36. {{(pid=75373) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.network.neutron [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [{"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-3ecc18d9-0877-40bd-9eea-58f53ee8f4df req-fc9d6182-aec9-4ae6-af9e-e87019cb5cbb service nova] Releasing lock "refresh_cache-cfc0dd8e-69d3-462f-811c-07e20dc5af4a" {{(pid=75373) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:03:09 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Instance destroyed successfully.
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.objects.instance [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lazy-loading 'resources' on Instance uuid cfc0dd8e-69d3-462f-811c-07e20dc5af4a {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1019254850',display_name='tempest-TestVolumeBootPattern-server-1019254850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1019254850',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTT1oVjzJb8hzslB63GwLSfcjJjCjUTGW81h+QQWnY+IZiwBWP+YLYU4pGbLoj3mfFYRscJGd1EyMOTVv19F0JZ8uRP5OCsy1YvYo6bcnIwFfxEpmn/a9xM03FNCAPmlA==',key_name='tempest-TestVolumeBootPattern-1344578036',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:58:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9f92519c816456f9f7acab9ceed7842',ramdisk_id='',reservation_id='r-4ve0k9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-305019745',owner_user_name='tempest-TestVolumeBootPattern-305019745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T07:58:29Z,user_data=None,user_id='00a5f98116e64893bd35e1a4e34e7e45',uuid=cfc0dd8e-69d3-462f-811c-07e20dc5af4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converting VIF {"id": "8a791927-534f-4791-966d-fae7262edc36", "address": "fa:16:3e:f9:a7:1a", "network": {"id": "22b73c9c-2307-493a-9d32-6caa0915cc3f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-77024658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9f92519c816456f9f7acab9ceed7842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a791927-53", "ovs_interfaceid": "8a791927-534f-4791-966d-fae7262edc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_vif [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a791927-53, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9cea652-6d4c-48e5-bafd-ee1fb542048e) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:09 user nova-compute[75373]: INFO os_vif [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a7:1a,bridge_name='br-int',has_traffic_filtering=True,id=8a791927-534f-4791-966d-fae7262edc36,network=Network(22b73c9c-2307-493a-9d32-6caa0915cc3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a791927-53')
Nov 29 08:03:09 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIJYQCvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:03:09 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333d642-025d-4c69-bc92-3799fad287c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 08:03:09 user nova-compute[75373]: No targets found.
Nov 29 08:03:09 user nova-compute[75373]: iSNS:
Nov 29 08:03:09 user nova-compute[75373]: No targets found.
Nov 29 08:03:09 user nova-compute[75373]: STATIC:
Nov 29 08:03:09 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd
Nov 29 08:03:09 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:03:09 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:03:09 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5
Nov 29 08:03:09 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:03:09 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:03:09 user nova-compute[75373]: FIRMWARE:
Nov 29 08:03:09 user nova-compute[75373]: No targets found.
Nov 29 08:03:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 08:03:09 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 08:03:09 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[16533869-d579-4c8b-bc04-4b27d38e19ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f7c6f-048c-4a3d-aa9b-a057a5b65cac]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:03:09 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:03:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd (non-flash)
Nov 29 08:03:09 user nova-compute[75373]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:03:09 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae033feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd'): ({'sdb'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Removing single pathed devices sdb {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd894d2-99a1-4f44-8acb-e7eb7f896bce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:09 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ddc076-d0ec-4600-83f4-866abae03b58]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Flushing IO for device /dev/sdb {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc4b36d-0153-4083-b97e-9565ec20e82d]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae1608-3157-4381-851a-08fa21aeb88d]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] SCSI volumes sdb have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[2096518c-f7bb-48a3-a859-7a96e7888aa9]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f29c9-3ecd-44a7-89c7-36e1aaf791d8]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260]
Nov 29 08:03:10 user nova-compute[75373]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd, portal: 172.16.0.220,3260] successful.
Nov 29 08:03:10 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f36a9c57-22bb-482e-9b1c-62b45f910cfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18dcce-7f09-45c7-b0a3-98c900c29118]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] <== disconnect_volume: return (422ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 08:03:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Deleting instance files /opt/stack/data/nova/instances/cfc0dd8e-69d3-462f-811c-07e20dc5af4a_del
Nov 29 08:03:10 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Deletion of /opt/stack/data/nova/instances/cfc0dd8e-69d3-462f-811c-07e20dc5af4a_del complete
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75373) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 08:03:10 user nova-compute[75373]: INFO nova.compute.manager [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 08:03:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:03:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=24.9549560546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Instance a62799fd-e91c-4606-acf7-af43787188c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75373) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:03:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:03:11 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Took 0.44 seconds to deallocate network for instance.
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-ab865bbc-08cc-42ba-ae6f-8a123c77d633 req-ba18460c-b058-4ca9-bc3f-8dc2204c12fe service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-deleted-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] Acquiring lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.compute.manager [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] No waiting events found dispatching network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:03:11 user nova-compute[75373]: WARNING nova.compute.manager [req-fba70318-abcb-45b4-b527-8751819ad256 req-c6f0f960-ea52-45eb-b4d6-231e5d820fee service nova] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Received unexpected event network-vif-plugged-8a791927-534f-4791-966d-fae7262edc36 for instance with vm_state active and task_state deleting.
Nov 29 08:03:11 user nova-compute[75373]: INFO nova.compute.manager [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] [instance: cfc0dd8e-69d3-462f-811c-07e20dc5af4a] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 08:03:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:03:11 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:03:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:12 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Deleted allocations for instance cfc0dd8e-69d3-462f-811c-07e20dc5af4a
Nov 29 08:03:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-96cbd2d4-15a4-4a9a-b056-e3b248cab25c tempest-TestVolumeBootPattern-305019745 tempest-TestVolumeBootPattern-305019745-project-member] Lock "cfc0dd8e-69d3-462f-811c-07e20dc5af4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:03:14 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:17 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a62799fd-e91c-4606-acf7-af43787188c4 is timed out.
Nov 29 08:03:17 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully detached device vdb from instance a62799fd-e91c-4606-acf7-af43787188c4 from the live domain config.
Nov 29 08:03:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] calling os-brick to detach iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f3b004b35e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZmJzeqIP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 08:03:17 user nova-compute[75373]: WARNING os_brick.initiator.connectors.base [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7da22-b03f-45e9-a045-7b9306a670d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 08:03:17 user nova-compute[75373]: No targets found.
Nov 29 08:03:17 user nova-compute[75373]: iSNS:
Nov 29 08:03:17 user nova-compute[75373]: No targets found.
Nov 29 08:03:17 user nova-compute[75373]: STATIC:
Nov 29 08:03:17 user nova-compute[75373]: Target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5
Nov 29 08:03:17 user nova-compute[75373]:         Portal: 172.16.0.220:3260,-1
Nov 29 08:03:17 user nova-compute[75373]:                 Iface Name: default
Nov 29 08:03:17 user nova-compute[75373]: FIRMWARE:
Nov 29 08:03:17 user nova-compute[75373]: No targets found.
Nov 29 08:03:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 08:03:17 user nova-compute[75373]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 08:03:17 user nova-compute[75373]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75373) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5', 0)] {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2bc889-fb23-478f-a00d-08b926ed5e30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ca06a-17ef-423a-b2d5-d9f0af6f2afb]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:03:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 (non-flash)
Nov 29 08:03:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3ae0449c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5'): ({'sdd'}, set())}) {{(pid=75373) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Removing single pathed devices sdd {{(pid=75373) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f9af1-c5f9-4dbe-92da-87e4a2b2d48f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.016s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[57afe0ca-d1f9-4bd6-a443-913b4b88dece]: (4, ('ok\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Flushing IO for device /dev/sdd {{(pid=75373) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[39faf501-7bdd-4ea8-86c8-f2b5b6f512ef]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75373) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f0201-3a43-463b-a2fe-a0933238ff89]: (4, ('1', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.linuxscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] SCSI volumes sdd have been removed. {{(pid=75373) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5')] {{(pid=75373) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d4e46-7e10-4580-b409-40cbbaef31d3]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --logout {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[abed4dcb-5a02-4b66-a277-15886e6f7ea7]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260]
Nov 29 08:03:17 user nova-compute[75373]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5, portal: 172.16.0.220,3260] successful.
Nov 29 08:03:17 user nova-compute[75373]:  stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op delete {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cb9d5d6-e586-4d76-8580-8846b9734bc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86370) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2cb177-e7e3-4f52-b3e5-b212e25a0400]: (4, ('', '')) {{(pid=86370) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75373) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.base [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG os_brick.initiator.connectors.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] <== disconnect_volume: return (293ms) None {{(pid=75373) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 08:03:17 user nova-compute[75373]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Disconnected iSCSI Volume {{(pid=75373) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 08:03:18 user nova-compute[75373]: DEBUG nova.objects.instance [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'flavor' on Instance uuid a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:03:18 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-83a978a9-87f1-4fb8-9938-e1f7495fd714 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:19 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:22 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:23 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:24 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:29 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:03:34 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:35 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:03:39 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:44 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:49 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:50 user nova-compute[75373]: INFO nova.compute.manager [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Terminating instance
Nov 29 08:03:50 user nova-compute[75373]: DEBUG nova.compute.manager [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Start destroying the instance on the hypervisor. {{(pid=75373) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:03:50 user nova-compute[75373]: DEBUG nova.compute.manager [req-f20a4eac-79ce-447e-ab43-a0e74e80705b req-a95b0fdf-4930-4cce-87da-e26fe5f514eb service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-unplugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with task_state deleting. {{(pid=75373) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Instance destroyed successfully.
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.objects.instance [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lazy-loading 'resources' on Instance uuid a62799fd-e91c-4606-acf7-af43787188c4 {{(pid=75373) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.virt.libvirt.vif [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T07:58:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-615096918',display_name='tempest-TestMinimumBasicScenario-server-615096918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-615096918',id=51,image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqHcA7E550dY8s8pIpGZ+WRXRRYBIS9yvTTXX6bQ3MfTWmuFIG+KaVH57IqCEbpzuPHEEx+xVKT6damjJwjcGwo9eCICXswEn9tMRuUaDUt6jkN+fC8sAjsWRABHY6zKg==',key_name='tempest-TestMinimumBasicScenario-1679106016',keypairs=<?>,launch_index=0,launched_at=2023-11-29T07:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ef78e97ba874f0cb154f8f941708330',ramdisk_id='',reservation_id='r-9rbpuo2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='052bc6bf-b6a6-4121-8fc5-18cbd43ee9ed',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1027187955',owner_user_name='tempest-TestMinimumBasicScenario-1027187955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T08:01:11Z,user_data=None,user_id='163bc599637749ff819b798c5efe7867',uuid=a62799fd-e91c-4606-acf7-af43787188c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converting VIF {"id": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "address": "fa:16:3e:d6:b0:52", "network": {"id": "ed00c031-7a20-48cf-a793-b69ade5888c5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-423795335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ef78e97ba874f0cb154f8f941708330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc4374f-71", "ovs_interfaceid": "2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.network.os_vif_util [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71') {{(pid=75373) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG os_vif [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71') {{(pid=75373) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cc4374f-71, bridge=br-int, if_exists=True) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c98eb9ef-e592-4c45-8c08-7ec6197ec88a) {{(pid=75373) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:03:51 user nova-compute[75373]: INFO os_vif [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e,network=Network(ed00c031-7a20-48cf-a793-b69ade5888c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc4374f-71')
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Deleting instance files /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4_del
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.virt.libvirt.driver [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Deletion of /opt/stack/data/nova/instances/a62799fd-e91c-4606-acf7-af43787188c4_del complete
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.compute.manager [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 08:03:51 user nova-compute[75373]: DEBUG oslo.service.loopingcall [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75373) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.compute.manager [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Deallocating network for instance {{(pid=75373) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] deallocate_for_instance() {{(pid=75373) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.network.neutron [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Updating instance_info_cache with network_info: [] {{(pid=75373) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.compute.manager [-] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Took 0.37 seconds to deallocate network for instance.
Nov 29 08:03:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:03:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:51 user nova-compute[75373]: INFO nova.scheduler.client.report [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Deleted allocations for instance a62799fd-e91c-4606-acf7-af43787188c4
Nov 29 08:03:51 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-a1bd8e73-bce7-46d8-891e-807edc9a58e5 tempest-TestMinimumBasicScenario-1027187955 tempest-TestMinimumBasicScenario-1027187955-project-member] Lock "a62799fd-e91c-4606-acf7-af43787188c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.595s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] Acquiring lock "a62799fd-e91c-4606-acf7-af43787188c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:03:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:03:52 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] Lock "a62799fd-e91c-4606-acf7-af43787188c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:03:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] No waiting events found dispatching network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 08:03:52 user nova-compute[75373]: WARNING nova.compute.manager [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received unexpected event network-vif-plugged-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e for instance with vm_state deleted and task_state None.
Nov 29 08:03:52 user nova-compute[75373]: DEBUG nova.compute.manager [req-e2b46144-73b6-47b2-9796-beb55d66f275 req-fa011001-b083-4457-ba6a-2e8a8bf9015a service nova] [instance: a62799fd-e91c-4606-acf7-af43787188c4] Received event network-vif-deleted-2cc4374f-71f9-4ff9-aa8a-fc74bf17b35e {{(pid=75373) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 08:03:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:00 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:01 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:04:01 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 08:04:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:08 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:04:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:04:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:04:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:04:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9153MB free_disk=24.981647491455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:04:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:04:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:13 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:04:14 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:17 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:24 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:25 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:04:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:04:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:04:43 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:04:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:02 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:05:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 08:05:02 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 08:05:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:05:09 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:05:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:05:10 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9208MB free_disk=25.01226043701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:05:10 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:05:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:13 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:05:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:17 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:21 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:25 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:05:26 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:27 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:31 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75373) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75373) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 08:05:36 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:38 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:05:41 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:46 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:51 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:05:53 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:05:56 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:06:01 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:06:03 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:06:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Starting heal instance info cache {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 08:06:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Rebuilding the list of instances to heal {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 08:06:03 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Didn't find any instances for network info cache update. {{(pid=75373) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 08:06:06 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:06:10 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:06:11 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Auditing locally available compute resources for user (node: user) {{(pid=75373) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 08:06:12 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:06:12 user nova-compute[75373]: WARNING nova.virt.libvirt.driver [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Hypervisor/Node resource view: name=user free_ram=9337MB free_disk=25.004989624023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75373) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75373) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.compute.provider_tree [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed in ProviderTree for provider: 7470e514-a168-44fb-900f-165629289ced {{(pid=75373) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.scheduler.client.report [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Inventory has not changed for provider 7470e514-a168-44fb-900f-165629289ced based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75373) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG nova.compute.resource_tracker [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Compute_service record updated for user:user {{(pid=75373) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 08:06:12 user nova-compute[75373]: DEBUG oslo_concurrency.lockutils [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75373) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 08:06:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:06:15 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 08:06:15 user nova-compute[75373]: DEBUG nova.compute.manager [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75373) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 08:06:16 user nova-compute[75373]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75373) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 08:06:16 user nova-compute[75373]: DEBUG oslo_service.periodic_task [None req-d2eb3c07-da24-4402-899b-93666e4d4339 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75373) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}